-- Logs begin at Thu 2022-09-15 12:17:10 UTC, end at Thu 2022-09-15 13:15:29 UTC. -- Sep 15 12:44:07.401390 dv-cinder-836083-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 12:44:07 2022] *** Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: nodename: dv-cinder-836083-13-smb Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: machine: x86_64 Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: clock source: unix Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: pcre jit disabled Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: detected number of CPU cores: 4 Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: current working directory: / Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: detected binary path: /usr/bin/uwsgi-core Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: your processes number limit is 47680 Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: your memory page size is 4096 bytes Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: detected max file descriptor number: 2048 Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: lock engine: pthread robust mutexes Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: thunder lock: enabled Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 12:44:07.416433 dv-cinder-836083-13-smb devstack@keystone.service[81575]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 12:44:07.451185 dv-cinder-836083-13-smb devstack@keystone.service[81575]: Python main interpreter initialized at 0x561b0178b9c0 Sep 15 12:44:07.451185 dv-cinder-836083-13-smb devstack@keystone.service[81575]: python threads support enabled Sep 15 12:44:07.451185 dv-cinder-836083-13-smb devstack@keystone.service[81575]: your server socket listen backlog is limited to 100 connections Sep 15 12:44:07.451185 dv-cinder-836083-13-smb devstack@keystone.service[81575]: your mercy for graceful operations on workers is 90 seconds Sep 15 12:44:07.451530 dv-cinder-836083-13-smb devstack@keystone.service[81575]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 12:44:07.451605 dv-cinder-836083-13-smb devstack@keystone.service[81575]: *** Operational MODE: preforking *** Sep 15 12:44:07.451920 dv-cinder-836083-13-smb devstack@keystone.service[81575]: *** uWSGI is running in multiple interpreter mode *** Sep 15 12:44:07.451920 dv-cinder-836083-13-smb devstack@keystone.service[81575]: spawned uWSGI master process (pid: 81575) Sep 15 12:44:07.452127 dv-cinder-836083-13-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 15 12:44:07.452664 dv-cinder-836083-13-smb devstack@keystone.service[81575]: spawned uWSGI worker 1 (pid: 81588, cores: 1) Sep 15 12:44:07.452989 dv-cinder-836083-13-smb devstack@keystone.service[81575]: spawned uWSGI worker 2 (pid: 81589, cores: 1) Sep 15 12:44:07.455482 dv-cinder-836083-13-smb devstack@keystone.service[81575]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 12:44:11.698487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:44:11.698487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: from cryptography.utils import int_from_bytes Sep 15 12:44:11.699268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:44:11.699268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: from cryptography.utils import int_from_bytes Sep 15 12:44:11.699268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:44:11.699268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: from cryptography.utils import int_from_bytes Sep 15 12:44:11.699958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:44:11.699958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: from cryptography.utils import int_from_bytes Sep 15 12:44:11.748094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:44:11.748300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:44:11.748387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:44:11.748464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:44:11.748526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] command line args: [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:44:11.748588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] command line args: [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:44:11.748716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:44:11.748848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:44:11.748938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ================================================================================ {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:44:11.749011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ================================================================================ {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:44:11.749178 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] admin_token = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.749317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] admin_token = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.749394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] config_dir = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.749540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] config_dir = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.749667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.749745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.749942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] config_source = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.750073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] config_source = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.750148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] debug = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.750210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] debug = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.750267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.751724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.751839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.751910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.751975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] list_limit = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] list_limit = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] log_config_append = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] log_config_append = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] log_dir = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] log_dir = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] log_file = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] log_file = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.752973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.753908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.754917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.755049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.755174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.755295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.755418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.755560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.755685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.755965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] publish_errors = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] publish_errors = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.756942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] standard_threads = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] standard_threads = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.757965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] use_journal = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] use_journal = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] use_json = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] use_json = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] use_stderr = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] use_stderr = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] use_syslog = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] use_syslog = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.758937 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:44:11.759078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.759203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.759296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.759372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.759552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.759686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.759799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.759874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.760973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.761973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.762916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.763902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764558 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.764915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.765110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.765304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.765523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.765621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.765751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.765992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.766954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.767923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.768972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.769947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.770868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.771952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.772952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.773989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.774927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.775008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.775314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.775403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.775575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.775773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.775900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.776060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.776191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.776280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.776511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.776660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.776740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.776975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.777066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.777207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.777447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.777528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.777681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.777908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.778001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.778148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.778320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.778399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.778596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.778736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.778835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.779043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.779177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.779298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.779532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.779645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.779795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.780980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.781184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.781379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.781479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.781622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.781703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.781845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.781924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.782996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.783992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] auth.external = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.784946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] auth.password = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] auth.token = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.785885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.786984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] credential.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.787965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] auth.external = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.788904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] auth.password = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] auth.token = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.789945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.790895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] credential.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.791895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.792974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.793931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.794963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.795946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.796103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.796280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.796381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.796572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.796654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.796834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.796924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.797912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.798880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.799991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.800997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.801976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.802901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.803856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.804981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.805952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.806999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.807992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.808980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.809965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.810864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.811855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.812974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.813978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.814921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.815885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.816988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] role.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.817994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] role.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.818932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.819993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.820847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] role.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] role.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.821990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.822968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.823944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.824889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.825941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.826965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.827129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.827211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.827416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.827506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.827655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.827885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.827966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828633 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.828883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.829851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.connection = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.830940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.831990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.832932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.833860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834568 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.connection = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.834861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:44:11.834992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.835228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.835470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.835717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.835960 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.836194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.836430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.836675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.836912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.837157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.837392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.837639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.837875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.838119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.838349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.838587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.838819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:44:11.838986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:44:11.864420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.864642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.864865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.869236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.869468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.869690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.873026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.878116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.900796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.901005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.903530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.903756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.953046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:11.953538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.000853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.001067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.001521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.001752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.159994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.160054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.160129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.160329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.183550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.183689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.183873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.184924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.185059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.185156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.196094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.196378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.208869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.209946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.210072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.210142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.210203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81588) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.210323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.210561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81589) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:44:12.226996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.227128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.227197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:44:12.227259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:44:12.227526 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.227675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.227777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:44:12.227856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:44:12.227999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.228124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.228225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.228306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.228464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.228558 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.228746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.228874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.238708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.238830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.239007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.239130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.239243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.239352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.239535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.239659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.246527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.246744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.249453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.249692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.249827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.249935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.250013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.250245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.250390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.250496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.250586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.250787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.250916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.251891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.252096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.252222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.252349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.275140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.275266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.276623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.276787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.276884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.277088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.281600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.281838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.281966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.282114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.282265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.282361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.288490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.288770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.288895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.289065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.294389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.294679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.294803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.294958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.295084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.295206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.295298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.295509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.295766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.295856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.296029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.296213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.296759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.296944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.297112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.297112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.312204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.312443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.312677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.312975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.316272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.317036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.319462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.319782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.320310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.320601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.323942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.324852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.327140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.328213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.330750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.331045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.331325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.331448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.331593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.331769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.331865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.332058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.332148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.332351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.332630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.332895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.348041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.348322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.348582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.348837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.348963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.349095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.349396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.349656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.355663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.356548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.357245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.358116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.358869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.359141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.359717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.360005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.361868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.362147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.362431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.362708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.362830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.362993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.363126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.363271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.363926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.364319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.374676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.375104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.375384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.375507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.375650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.375817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.376052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.376186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.376295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.376389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.376562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.376725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.376999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.377273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.392080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.392830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.395006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.395741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.397919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.398663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.399364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.400182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.400855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.401129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.401518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.401636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.401930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.402327 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.407930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.408911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.409380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.410388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.412278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.412675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.412955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.413220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.413346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.413723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.414009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.414270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.421090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.421477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.421823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.422288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.422578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.422859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.428761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81589) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.429039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.429313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.429577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.429838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81588) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:44:12.429959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.430967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.431124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.431211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.431417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.431537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.431669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.431776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.431981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.432121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.432262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.432398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81589) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.432537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.432787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.433046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.433317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81588) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:44:12.466315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b0178b9c0 pid: 81589 (default app) Sep 15 12:44:12.467600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561b0178b9c0 pid: 81588 (default app) Sep 15 12:44:12.469732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691c10-d934-437b-a102-e87130dbb523 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:12.470022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691c10-d934-437b-a102-e87130dbb523 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:12.470284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7691c10-d934-437b-a102-e87130dbb523 None None] PATH_INFO: `/v3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:12.474455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Sep 15 12:44:12 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:19.286044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa43e-d881-4832-83b9-90123e2001d9 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:19.286599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa43e-d881-4832-83b9-90123e2001d9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:19.286599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa43e-d881-4832-83b9-90123e2001d9 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:19.290894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:44:19.297690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:19.298448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:19.298681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:19.380573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: INFO dbcounter [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] Registered counter for database keystone Sep 15 12:44:19.401818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG oslo_db.sqlalchemy.engines [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:44:19.411217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writer thread running {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:44:19.596306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG passlib.handlers.bcrypt [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81589) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 12:44:19.596594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG passlib.handlers.bcrypt [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81589) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 12:44:19.660334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:19.661931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:19.801467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 12:44:20.285246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baa43e-d881-4832-83b9-90123e2001d9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:20.356628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: INFO dbcounter [None req-92baa43e-d881-4832-83b9-90123e2001d9 None None] Registered counter for database keystone Sep 15 12:44:20.382497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG oslo_db.sqlalchemy.engines [None req-92baa43e-d881-4832-83b9-90123e2001d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:44:20.390391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writer thread running {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:44:20.512967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baa43e-d881-4832-83b9-90123e2001d9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:20.518999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80f822-6eb6-43e6-97fb-0e45bbedf59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:20.519638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f822-6eb6-43e6-97fb-0e45bbedf59a admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:20.519943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f822-6eb6-43e6-97fb-0e45bbedf59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:20.520213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80f822-6eb6-43e6-97fb-0e45bbedf59a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:20.529357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80f822-6eb6-43e6-97fb-0e45bbedf59a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:20.582361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1c80f822-6eb6-43e6-97fb-0e45bbedf59a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 12:44:20.582635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80f822-6eb6-43e6-97fb-0e45bbedf59a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:20.592780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Sep 15 12:44:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:44:20.600277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:20.622766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320b90-6508-4947-9fe3-6ee9267a0150 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:20.629597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa171c7-6391-4bf7-ab69-a76b5d730a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:20.630733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa171c7-6391-4bf7-ab69-a76b5d730a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:20.631009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa171c7-6391-4bf7-ab69-a76b5d730a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:20.631271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa171c7-6391-4bf7-ab69-a76b5d730a7b admin admin] PATH_INFO: `/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:20.633112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa171c7-6391-4bf7-ab69-a76b5d730a7b admin admin] RBAC: Authorizing `identity:get_project(project_id=f45a231e90ab44d5b27215f7d1c94ccd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:20.685887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3aa171c7-6391-4bf7-ab69-a76b5d730a7b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 12:44:20.686220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa171c7-6391-4bf7-ab69-a76b5d730a7b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:20.691001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Sep 15 12:44:20 2022] GET /identity/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:22.825587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320025-c7e2-4d51-b15b-2ef39b1f1b79 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:22.826437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320025-c7e2-4d51-b15b-2ef39b1f1b79 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:22.826437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320025-c7e2-4d51-b15b-2ef39b1f1b79 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:22.831195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:22.838131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4b1e-99bb-436b-b3f5-a7a74b40a06c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:22.838586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4b1e-99bb-436b-b3f5-a7a74b40a06c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:22.838678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4b1e-99bb-436b-b3f5-a7a74b40a06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:22.867880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5e2b4b1e-99bb-436b-b3f5-a7a74b40a06c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:22.869430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5e2b4b1e-99bb-436b-b3f5-a7a74b40a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:22.879755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 12:44:23.145100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320025-c7e2-4d51-b15b-2ef39b1f1b79 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:23.159679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320025-c7e2-4d51-b15b-2ef39b1f1b79 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:23.168103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f4088-9559-4a35-b00f-51f115dc8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:23.169096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4088-9559-4a35-b00f-51f115dc8320 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:23.169560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4088-9559-4a35-b00f-51f115dc8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:23.170000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4088-9559-4a35-b00f-51f115dc8320 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:23.184270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f4088-9559-4a35-b00f-51f115dc8320 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:23.187047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f4088-9559-4a35-b00f-51f115dc8320 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:23.196269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Sep 15 12:44:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:44:23.202372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4b1e-99bb-436b-b3f5-a7a74b40a06c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:23.217153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4b1e-99bb-436b-b3f5-a7a74b40a06c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:23.223278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf9f89-bbd4-475e-8e10-b9ce40db69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:23.223937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf9f89-bbd4-475e-8e10-b9ce40db69fa admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:23.224209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf9f89-bbd4-475e-8e10-b9ce40db69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:23.224468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf9f89-bbd4-475e-8e10-b9ce40db69fa admin admin] PATH_INFO: `/v3/users/e74cf16638b84fdcb3063b017c210c9d` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:23.225914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf9f89-bbd4-475e-8e10-b9ce40db69fa admin admin] RBAC: Authorizing `identity:get_user(user_id=e74cf16638b84fdcb3063b017c210c9d)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:23.227746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf9f89-bbd4-475e-8e10-b9ce40db69fa admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:23.229296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Sep 15 12:44:23 2022] GET /identity/v3/users/e74cf16638b84fdcb3063b017c210c9d => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:25.422303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded0beb-ba3b-467b-b67e-d44be59edd89 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:25.422849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded0beb-ba3b-467b-b67e-d44be59edd89 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:25.422849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded0beb-ba3b-467b-b67e-d44be59edd89 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:25.424395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:25.429564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072abb70-904c-4ec1-ad87-3516960a0130 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:25.430019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072abb70-904c-4ec1-ad87-3516960a0130 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:25.430091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072abb70-904c-4ec1-ad87-3516960a0130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:25.449192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-072abb70-904c-4ec1-ad87-3516960a0130 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:25.450379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-072abb70-904c-4ec1-ad87-3516960a0130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:25.464469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8957-a295-4b96-bec6-b8c283cc34e2 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:25.464749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8957-a295-4b96-bec6-b8c283cc34e2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:25.465017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8957-a295-4b96-bec6-b8c283cc34e2 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:25.466350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:25.471599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:25.471905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:25.472176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:25.514592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG passlib.handlers.bcrypt [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81588) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 12:44:25.514983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG passlib.handlers.bcrypt [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81588) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 12:44:25.534648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:25.563317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:25.564951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:25.666611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:25.794986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072abb70-904c-4ec1-ad87-3516960a0130 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:25.820871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:25.903816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072abb70-904c-4ec1-ad87-3516960a0130 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:25.930854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:25.945601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:25.946275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:25.946547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:25.946814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:25.959067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:25.967965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:25.968899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:25.969724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:25.975041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:26.040318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40f258-6a61-4e5f-8869-1ded4848ba4c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:26.043311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:26.054407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:26.075957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a5427-f74d-42c0-9a7e-77caef156679 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:26.079377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b3680-c758-4902-9925-a75b20422441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:26.080293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b3680-c758-4902-9925-a75b20422441 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:26.080573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b3680-c758-4902-9925-a75b20422441 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:26.080842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b3680-c758-4902-9925-a75b20422441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:26.110612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:26.111227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:26.111497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:26.111797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:26.112465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:26.112766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:26.114519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:26.127079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:26.132687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:26.148726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b3680-c758-4902-9925-a75b20422441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:26.150248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b3680-c758-4902-9925-a75b20422441 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:26.232883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a80b6e-a0a6-46d9-ab5f-f89496116662 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:26.250885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:26.256735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b3680-c758-4902-9925-a75b20422441 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:26.259841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:26.268384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:26.269038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:26.269318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:26.269586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] PATH_INFO: `/v3/users/e74cf16638b84fdcb3063b017c210c9d` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:26.270796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] RBAC: Authorizing `identity:get_user(user_id=e74cf16638b84fdcb3063b017c210c9d)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:26.272307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:26.273889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:26 2022] GET /identity/v3/users/e74cf16638b84fdcb3063b017c210c9d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:26.279287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:26.294491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:26.357360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b3680-c758-4902-9925-a75b20422441 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:26.379043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfcff3-9c23-404c-a719-292d6588b497 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:26.390083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:26.390902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:26.391211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:26.391478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:26.410023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:26.411651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:26.414503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:26.415139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:26.415422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:26.415690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:26.416824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:26.418264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:26.419907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:26.426446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:44:26.430007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:26.431197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:44:26.432443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:44:26.432443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:44:26.432443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:26.432443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:26.437661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:26.495496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:26.520325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:26.539240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300665b-341d-4c57-8d6f-230618ecc076 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:26.540750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520edcd1-505e-44aa-8df7-e0a4482de9f2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:26.571912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77470e-0acb-49ba-88ba-a7fada5bc672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:26.572530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77470e-0acb-49ba-88ba-a7fada5bc672 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:26.572811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77470e-0acb-49ba-88ba-a7fada5bc672 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:26.573078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77470e-0acb-49ba-88ba-a7fada5bc672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:26.573855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77470e-0acb-49ba-88ba-a7fada5bc672 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.domain.id=default, user.id=e74cf16638b84fdcb3063b017c210c9d) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:26.574164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77470e-0acb-49ba-88ba-a7fada5bc672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:26.574363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee049da-6c71-4f46-8c12-60b70a12c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:26.574971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee049da-6c71-4f46-8c12-60b70a12c88a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:26.575247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee049da-6c71-4f46-8c12-60b70a12c88a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:26.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee049da-6c71-4f46-8c12-60b70a12c88a None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:26.575598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77470e-0acb-49ba-88ba-a7fada5bc672 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:26.576185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee049da-6c71-4f46-8c12-60b70a12c88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:26.576483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee049da-6c71-4f46-8c12-60b70a12c88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:26.577907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee049da-6c71-4f46-8c12-60b70a12c88a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:26.582400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Sep 15 12:44:26 2022] GET /identity/v3/role_assignments?user.id=e74cf16638b84fdcb3063b017c210c9d&scope.domain.id=default&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:26.597538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:28.994536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6983-f313-4bab-b872-77962394c7f4 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:28.995074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6983-f313-4bab-b872-77962394c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:28.995074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6983-f313-4bab-b872-77962394c7f4 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:28.996448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:29.013529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8db37-22b3-4696-937f-3d270cfd5c5a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:29.014067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8db37-22b3-4696-937f-3d270cfd5c5a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:29.014067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8db37-22b3-4696-937f-3d270cfd5c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:29.045022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c5a8db37-22b3-4696-937f-3d270cfd5c5a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:29.046349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c5a8db37-22b3-4696-937f-3d270cfd5c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:29.081192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134855-836a-467a-b9d5-7ce0f2ec3dfe None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:29.081481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134855-836a-467a-b9d5-7ce0f2ec3dfe None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:29.081721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134855-836a-467a-b9d5-7ce0f2ec3dfe None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:29.083277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:44:29.090555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba24f03-3cbf-43ae-ac00-fbbbe9e1ef64 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:29.090862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba24f03-3cbf-43ae-ac00-fbbbe9e1ef64 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:29.091097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba24f03-3cbf-43ae-ac00-fbbbe9e1ef64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:29.122680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6ba24f03-3cbf-43ae-ac00-fbbbe9e1ef64 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:29.123993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6ba24f03-3cbf-43ae-ac00-fbbbe9e1ef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:29.178496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:29.179803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ec2b-ddbb-4ded-9ead-d8da4fca3334 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:29.180089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ec2b-ddbb-4ded-9ead-d8da4fca3334 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:29.180357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ec2b-ddbb-4ded-9ead-d8da4fca3334 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:29.185489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 12/25] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:29.187053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c617a6-482b-4831-9374-d9e456845125 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:29.187334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c617a6-482b-4831-9374-d9e456845125 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:29.187611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c617a6-482b-4831-9374-d9e456845125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:29.218574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c9c617a6-482b-4831-9374-d9e456845125 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:29.220240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c9c617a6-482b-4831-9374-d9e456845125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:29.250550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:29.264938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:29.292402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:29.690946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba24f03-3cbf-43ae-ac00-fbbbe9e1ef64 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:29.720908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c617a6-482b-4831-9374-d9e456845125 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:29.817593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:29.865776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba24f03-3cbf-43ae-ac00-fbbbe9e1ef64 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:29.887108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c617a6-482b-4831-9374-d9e456845125 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:29.935205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de6ee7-7e4f-4b36-ae22-0181613819b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:29.935851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6ee7-7e4f-4b36-ae22-0181613819b0 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:29.936175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6ee7-7e4f-4b36-ae22-0181613819b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:29.936443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de6ee7-7e4f-4b36-ae22-0181613819b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:29.937123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de6ee7-7e4f-4b36-ae22-0181613819b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:29.938517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de6ee7-7e4f-4b36-ae22-0181613819b0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:29.953201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:29.953841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:29.954113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:29.954380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:29.979409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:29.986171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:29.987017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 14/28] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:44:29.988549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:30.035262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:30.083931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 15/29] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Sep 15 12:44:29 2022] POST /identity/v3/roles => generated 219 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:30.086049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6159-671b-4da8-a23b-be482a62de03 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.086554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6159-671b-4da8-a23b-be482a62de03 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.087040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6159-671b-4da8-a23b-be482a62de03 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.088644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:30.094725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a6159-671b-4da8-a23b-be482a62de03 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:30.103434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca29d8-48f5-4c5a-bf92-65afd51a8844 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:30.143081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413000-b3bf-49d5-90c1-c126ecdb4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:30.146266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413000-b3bf-49d5-90c1-c126ecdb4325 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.146537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413000-b3bf-49d5-90c1-c126ecdb4325 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.146799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413000-b3bf-49d5-90c1-c126ecdb4325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.166386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413000-b3bf-49d5-90c1-c126ecdb4325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:30.167920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413000-b3bf-49d5-90c1-c126ecdb4325 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-14413000-b3bf-49d5-90c1-c126ecdb4325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:44:30.201729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:30.203333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:44:30.204166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:44:30.204166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:44:30.204166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:30.204166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 15/31] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:30.206945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142c0f7-68ae-40a5-98e3-e8ed9faeb6b2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.207219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142c0f7-68ae-40a5-98e3-e8ed9faeb6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.207480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142c0f7-68ae-40a5-98e3-e8ed9faeb6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.249413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a142c0f7-68ae-40a5-98e3-e8ed9faeb6b2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:30.252029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a142c0f7-68ae-40a5-98e3-e8ed9faeb6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:30.317346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a6159-671b-4da8-a23b-be482a62de03 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:30.360079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:30.360286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 16/32] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:30.361146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.361266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142c0f7-68ae-40a5-98e3-e8ed9faeb6b2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:30.361747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.362229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.363444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:30.363967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:30.365827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:30.367845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:30.376649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:30.382312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:30.384838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:30.483930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142c0f7-68ae-40a5-98e3-e8ed9faeb6b2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:30.522777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:30.523405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.523685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.524001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.524648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:30.524945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:30.527323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:30.559017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 17/34] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:30.565384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:30.584902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4d66a-c08b-4fc4-b32f-45d51217a6c8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:30.649821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:30.651114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.652140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.652432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] PATH_INFO: `/v3/users/e74cf16638b84fdcb3063b017c210c9d` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.653936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] RBAC: Authorizing `identity:get_user(user_id=e74cf16638b84fdcb3063b017c210c9d)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:30.655583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:30.658204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:30 2022] GET /identity/v3/users/e74cf16638b84fdcb3063b017c210c9d => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:30.664793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:30.695516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:30.718599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5bd1-31da-4197-9ed2-16eb94eae27e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:30.755747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4802468-930a-48af-acf3-dabd4d32f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:30.756123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:30.756900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4802468-930a-48af-acf3-dabd4d32f1bc None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.757364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4802468-930a-48af-acf3-dabd4d32f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.757856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4802468-930a-48af-acf3-dabd4d32f1bc None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.758945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4802468-930a-48af-acf3-dabd4d32f1bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:30.760961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4802468-930a-48af-acf3-dabd4d32f1bc None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:30.800522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009fd38-7850-448f-b2a9-e018f86b87dd None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:30.841924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:30.843004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.843436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.843947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.845932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:30.848509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:30.862395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 19/36] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:30.862395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:30.903891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:44:30 2022] POST /identity/v3/projects => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:44:30.903891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181340-4169-4b73-a642-5aaf542a23da None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:30.903891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181340-4169-4b73-a642-5aaf542a23da None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:30.903891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82181340-4169-4b73-a642-5aaf542a23da None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:30.903891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 19/38] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:30.903891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181340-4169-4b73-a642-5aaf542a23da None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:31.008964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec44f7-82f2-4603-b29e-161e059004cd None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:31.044374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82181340-4169-4b73-a642-5aaf542a23da None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:31.050866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:31.057290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1cbee-4fb8-4b13-a3b3-0a19b39352c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:31.057934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1cbee-4fb8-4b13-a3b3-0a19b39352c3 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.058215 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1cbee-4fb8-4b13-a3b3-0a19b39352c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.058473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1cbee-4fb8-4b13-a3b3-0a19b39352c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.059165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1cbee-4fb8-4b13-a3b3-0a19b39352c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:31.060683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1cbee-4fb8-4b13-a3b3-0a19b39352c3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:31.080063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Sep 15 12:44:30 2022] POST /identity/v3/roles => generated 225 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:31.083161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:31.089316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920f27-6bd0-485c-a464-8115603b5030 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.089852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920f27-6bd0-485c-a464-8115603b5030 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.089852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920f27-6bd0-485c-a464-8115603b5030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.093906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5885c0-0c45-4608-a191-a17196867286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:31.094602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5885c0-0c45-4608-a191-a17196867286 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.094883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5885c0-0c45-4608-a191-a17196867286 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.095163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5885c0-0c45-4608-a191-a17196867286 None admin] PATH_INFO: `/v3/domains/default/users/e74cf16638b84fdcb3063b017c210c9d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.101942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5885c0-0c45-4608-a191-a17196867286 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e74cf16638b84fdcb3063b017c210c9d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:31.102838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5885c0-0c45-4608-a191-a17196867286 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:31.116585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-12920f27-6bd0-485c-a464-8115603b5030 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:31.117135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-12920f27-6bd0-485c-a464-8115603b5030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:31.123929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Sep 15 12:44:30 2022] PUT /identity/v3/domains/default/users/e74cf16638b84fdcb3063b017c210c9d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:44:31.125276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56722d5-207d-46b4-8820-8e9cc93af36e None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.125563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56722d5-207d-46b4-8820-8e9cc93af36e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.125824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56722d5-207d-46b4-8820-8e9cc93af36e None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.129087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 21/41] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:31.137925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382252e-f81d-433f-9695-19126815590b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.138886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382252e-f81d-433f-9695-19126815590b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.139516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382252e-f81d-433f-9695-19126815590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.166450 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8382252e-f81d-433f-9695-19126815590b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:31.170458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8382252e-f81d-433f-9695-19126815590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:31.216758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 21/42] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:31.279848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:31.496901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920f27-6bd0-485c-a464-8115603b5030 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:31.558723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382252e-f81d-433f-9695-19126815590b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:31.606706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920f27-6bd0-485c-a464-8115603b5030 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:31.632786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:31.648161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:31.648804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.649080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.649701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.650817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:31.652328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:31.654105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 22/44] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:31.659550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:31.668131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382252e-f81d-433f-9695-19126815590b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:31.688503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:31.704984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008cdf0-cafa-4143-9700-c34caab111e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:31.705714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008cdf0-cafa-4143-9700-c34caab111e7 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.706067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008cdf0-cafa-4143-9700-c34caab111e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.706402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008cdf0-cafa-4143-9700-c34caab111e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.707084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008cdf0-cafa-4143-9700-c34caab111e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:31.708525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008cdf0-cafa-4143-9700-c34caab111e7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:31.726154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Sep 15 12:44:31 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:31.772587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bdcb7-84f3-43ca-b594-18f7f6a3737f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:31.925451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e7c88-e323-43cb-9261-887712909a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:31.926095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7c88-e323-43cb-9261-887712909a7c None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:31.926364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7c88-e323-43cb-9261-887712909a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:31.926631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e7c88-e323-43cb-9261-887712909a7c None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:31.927293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e7c88-e323-43cb-9261-887712909a7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:31.928824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e7c88-e323-43cb-9261-887712909a7c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:31.962075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:44:31 2022] POST /identity/v3/projects => generated 312 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:44:33.346269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9bf9a-edc1-411d-8d62-bc70cdc28d05 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:33.346845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9bf9a-edc1-411d-8d62-bc70cdc28d05 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:33.346845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9bf9a-edc1-411d-8d62-bc70cdc28d05 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:33.348344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:33.353463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16bea-9f22-43b1-b167-65a69070e6a7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:33.353851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16bea-9f22-43b1-b167-65a69070e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:33.354016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16bea-9f22-43b1-b167-65a69070e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:33.373320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-37b16bea-9f22-43b1-b167-65a69070e6a7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:33.374882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-37b16bea-9f22-43b1-b167-65a69070e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:33.411247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:33.452524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:33.714946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9bf9a-edc1-411d-8d62-bc70cdc28d05 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:33.822736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9bf9a-edc1-411d-8d62-bc70cdc28d05 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:33.860486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:33.861126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:33.861406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:33.861675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:33.872611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:33.878136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:33.878990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:33.879774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:33.885225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16bea-9f22-43b1-b167-65a69070e6a7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:33.991987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16bea-9f22-43b1-b167-65a69070e6a7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:34.030249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de66739-b46a-41d2-933c-f21c5f4246c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:34.030872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66739-b46a-41d2-933c-f21c5f4246c2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.031151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66739-b46a-41d2-933c-f21c5f4246c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.031428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66739-b46a-41d2-933c-f21c5f4246c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.032136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de66739-b46a-41d2-933c-f21c5f4246c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:34.032438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de66739-b46a-41d2-933c-f21c5f4246c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:34.033834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de66739-b46a-41d2-933c-f21c5f4246c2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:34.044234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 25/50] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:34.050318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:34.099746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449218-58da-4209-8f94-76a995451ef1 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.100061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449218-58da-4209-8f94-76a995451ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.100328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449218-58da-4209-8f94-76a995451ef1 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.101698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 26/51] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:34.107658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a2bb-cbfa-4b41-86fc-8d3fc1bb804c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.108236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a2bb-cbfa-4b41-86fc-8d3fc1bb804c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.108481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a2bb-cbfa-4b41-86fc-8d3fc1bb804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.129137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0c38a2bb-cbfa-4b41-86fc-8d3fc1bb804c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:34.130366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0c38a2bb-cbfa-4b41-86fc-8d3fc1bb804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:34.159858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:34.199649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:34.202261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 27/52] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:34.259852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9761a5-88f7-4e36-ba95-d4f7ab7c5510 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:34.295307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:34.295979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.296253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.296521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] PATH_INFO: `/v3/users/e74cf16638b84fdcb3063b017c210c9d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.297686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] RBAC: Authorizing `identity:get_user(user_id=e74cf16638b84fdcb3063b017c210c9d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:34.299135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:34.300749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:34 2022] GET /identity/v3/users/e74cf16638b84fdcb3063b017c210c9d => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:34.306454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a2bb-cbfa-4b41-86fc-8d3fc1bb804c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:34.405376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a2bb-cbfa-4b41-86fc-8d3fc1bb804c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:34.440385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:34.441040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.441319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.441580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.442794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:34.444464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:34.446058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 28/54] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:34.452236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:34.466643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:34.499892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:34.555673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3cc52-d727-42e7-8c77-09184db6de9b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:34.565024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:34.569917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac313f-4173-48f7-9bd3-e0e9c0272a50 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:34.589958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:34.590576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.590862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.591131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.591883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.domain.id=default, user.id=e74cf16638b84fdcb3063b017c210c9d) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:34.592426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:34.594263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:34.602288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Sep 15 12:44:34 2022] GET /identity/v3/role_assignments?user.id=e74cf16638b84fdcb3063b017c210c9d&scope.domain.id=default&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:34.602521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c7aa3-9665-4afe-8d22-48806892d6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:34.603208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c7aa3-9665-4afe-8d22-48806892d6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.603487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c7aa3-9665-4afe-8d22-48806892d6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.603776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c7aa3-9665-4afe-8d22-48806892d6b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.604875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c7aa3-9665-4afe-8d22-48806892d6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:34.606327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c7aa3-9665-4afe-8d22-48806892d6b8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:34.607967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 29/56] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:34.614295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:34.726010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65373-f9cc-4a07-b800-2678c287a85c None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:34.763428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38406ee-2385-4f59-af6a-aef3a5c84dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:34.764355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38406ee-2385-4f59-af6a-aef3a5c84dc0 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:34.764601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38406ee-2385-4f59-af6a-aef3a5c84dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:34.764721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38406ee-2385-4f59-af6a-aef3a5c84dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:34.765380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38406ee-2385-4f59-af6a-aef3a5c84dc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:34.766864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38406ee-2385-4f59-af6a-aef3a5c84dc0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:34.799072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 28/57] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Sep 15 12:44:34 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:36.979880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c42398-d204-44c7-941a-b935add7fdcf None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:36.980430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c42398-d204-44c7-941a-b935add7fdcf None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:36.980430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c42398-d204-44c7-941a-b935add7fdcf None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:36.981783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 30/58] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:36.991004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573c3fb-e94d-4ccd-af79-3c02b9ecffbe None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:36.991473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573c3fb-e94d-4ccd-af79-3c02b9ecffbe None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:36.991560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573c3fb-e94d-4ccd-af79-3c02b9ecffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:37.016302 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f573c3fb-e94d-4ccd-af79-3c02b9ecffbe None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:37.017509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f573c3fb-e94d-4ccd-af79-3c02b9ecffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:37.037923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:37.093489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:37.359780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c42398-d204-44c7-941a-b935add7fdcf None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:37.471514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:37.476463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c42398-d204-44c7-941a-b935add7fdcf None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:37.512707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6b790-d901-4918-8645-2b32fddf16d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:37.513327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b790-d901-4918-8645-2b32fddf16d8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:37.513585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b790-d901-4918-8645-2b32fddf16d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:37.513844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b790-d901-4918-8645-2b32fddf16d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:37.515129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6b790-d901-4918-8645-2b32fddf16d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:37.516628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6b790-d901-4918-8645-2b32fddf16d8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:37.518181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 31/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:37.524120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573c3fb-e94d-4ccd-af79-3c02b9ecffbe None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:37.639239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573c3fb-e94d-4ccd-af79-3c02b9ecffbe None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:37.678219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d16bf-fd98-4277-bcee-cf5f1632aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:37.678835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d16bf-fd98-4277-bcee-cf5f1632aca9 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:37.679117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d16bf-fd98-4277-bcee-cf5f1632aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:37.679389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d16bf-fd98-4277-bcee-cf5f1632aca9 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:37.680059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d16bf-fd98-4277-bcee-cf5f1632aca9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:37.681519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d16bf-fd98-4277-bcee-cf5f1632aca9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:37.714973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 30/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:44:37 2022] POST /identity/v3/users => generated 275 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:41.115527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb9d9-5617-4026-bf9a-f555138b83ea None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.116557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb9d9-5617-4026-bf9a-f555138b83ea None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.117053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cb9d9-5617-4026-bf9a-f555138b83ea None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.119035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 32/62] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:41.125527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377a9d-61ee-4127-95f6-a28e94a47b6a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.126565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377a9d-61ee-4127-95f6-a28e94a47b6a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.127028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377a9d-61ee-4127-95f6-a28e94a47b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.156833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-08377a9d-61ee-4127-95f6-a28e94a47b6a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:41.158382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-08377a9d-61ee-4127-95f6-a28e94a47b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:41.161606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:41.224111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e14f9-16a7-4453-a507-1ec5baac6ea0 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.224743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e14f9-16a7-4453-a507-1ec5baac6ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.225208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e14f9-16a7-4453-a507-1ec5baac6ea0 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.226787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 33/63] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:44:41.231920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842465-64af-436d-9cae-8ea9120808fb None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.232425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842465-64af-436d-9cae-8ea9120808fb None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.232885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842465-64af-436d-9cae-8ea9120808fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.252185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4f842465-64af-436d-9cae-8ea9120808fb None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:41.253533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 31/64] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:41.253927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4f842465-64af-436d-9cae-8ea9120808fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:41.323726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 34/65] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:41.442278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2111-e2a0-4832-a583-692f35630a24 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.442564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2111-e2a0-4832-a583-692f35630a24 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.442837 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a2111-e2a0-4832-a583-692f35630a24 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.444236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 32/66] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:41.449683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fccdd-91b2-47d5-bceb-60f56d6ee40c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.449973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fccdd-91b2-47d5-bceb-60f56d6ee40c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.450244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fccdd-91b2-47d5-bceb-60f56d6ee40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.473297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-828fccdd-91b2-47d5-bceb-60f56d6ee40c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:41.474544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-828fccdd-91b2-47d5-bceb-60f56d6ee40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:41.494359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ce76-4e75-4775-a9e9-1c304a2d2e65 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.494949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ce76-4e75-4775-a9e9-1c304a2d2e65 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.495467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ce76-4e75-4775-a9e9-1c304a2d2e65 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.502712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 33/67] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:44:41.513080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4da316-32a5-4e84-b69a-a277ebe3f467 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.513638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4da316-32a5-4e84-b69a-a277ebe3f467 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.514096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4da316-32a5-4e84-b69a-a277ebe3f467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.551546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8b4da316-32a5-4e84-b69a-a277ebe3f467 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:41.552824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 35/68] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:41.553296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8b4da316-32a5-4e84-b69a-a277ebe3f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:41.627304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fccdd-91b2-47d5-bceb-60f56d6ee40c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:41.658484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:41.659399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4da316-32a5-4e84-b69a-a277ebe3f467 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:41.665924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:41.786310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:41.798002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fccdd-91b2-47d5-bceb-60f56d6ee40c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:41.830090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4da316-32a5-4e84-b69a-a277ebe3f467 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:41.839662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe157d-3b3d-463f-ab71-393412a9f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:41.840329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe157d-3b3d-463f-ab71-393412a9f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.840606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe157d-3b3d-463f-ab71-393412a9f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.840868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe157d-3b3d-463f-ab71-393412a9f2e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.851926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe157d-3b3d-463f-ab71-393412a9f2e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3cbe157d-3b3d-463f-ab71-393412a9f2e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:41.856763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:41.857590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:41.858352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 36/70] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:44:41.859655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a25a5e-10d0-4264-8cca-5b915d56467d None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.859955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a25a5e-10d0-4264-8cca-5b915d56467d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.860217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a25a5e-10d0-4264-8cca-5b915d56467d None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.861451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 37/71] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:41.862294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a25a5e-10d0-4264-8cca-5b915d56467d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:41.877209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57d131-e20a-4ed2-b1e3-507ea9498c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:41.878194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d131-e20a-4ed2-b1e3-507ea9498c37 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.878617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d131-e20a-4ed2-b1e3-507ea9498c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.879026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d131-e20a-4ed2-b1e3-507ea9498c37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.892067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57d131-e20a-4ed2-b1e3-507ea9498c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-8b57d131-e20a-4ed2-b1e3-507ea9498c37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:41.897687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:41.898592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:41.899441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:41.901365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 35/72] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:41.903992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46513a4-539d-476c-bef7-1116b0a0e225 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:41.904470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46513a4-539d-476c-bef7-1116b0a0e225 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:41.904746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46513a4-539d-476c-bef7-1116b0a0e225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:41.922570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b46513a4-539d-476c-bef7-1116b0a0e225 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:41.923814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b46513a4-539d-476c-bef7-1116b0a0e225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:41.956840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:41.971373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a25a5e-10d0-4264-8cca-5b915d56467d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:41.995991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 36/73] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:41.996900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46513a4-539d-476c-bef7-1116b0a0e225 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.007037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.007681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.007985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.008255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.018525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:42.023538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:42.024412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:42.025164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:44:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:42.028492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.075242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.124170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46513a4-539d-476c-bef7-1116b0a0e225 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.135737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e640b-c4fc-4de1-aada-d8b0c0cba3b9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.160691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.161314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.161584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.161854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.162515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:42.162973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.164401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.171243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.171963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.172239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.172505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.173160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:42.173457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.174856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.176124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:42.176757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.183651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:42.184539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.201567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.290855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78c205-9769-4a50-9d29-524c92e561f9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.291051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097458ef-eda4-4a84-a798-dbaca2cca540 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.312920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.324256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.324870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.324973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.325146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.325460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.325568 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.325802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.326070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:42.326155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.326363 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.327179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.327894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.328742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.330323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 38/77] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:42.334022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.340718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 40/78] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:42.340718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.409613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.434741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d02e9-d98c-4c5e-8e30-b9be60f553ec None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.444110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939a85-7e67-476e-9964-d33e18f6a102 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.469381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.470021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.470303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.470577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] PATH_INFO: `/v3/users/e74cf16638b84fdcb3063b017c210c9d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.471723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] RBAC: Authorizing `identity:get_user(user_id=e74cf16638b84fdcb3063b017c210c9d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.473202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.474784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 39/79] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/users/e74cf16638b84fdcb3063b017c210c9d => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:42.475539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.476961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.477611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.477898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.478167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.491932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.493407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.495056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 41/80] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:42.495814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.541785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.584562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254226-dbea-41f6-9752-a401a4a2ac2e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.595823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc0ba-ba84-4245-9b7c-4bd36591aa8f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.617938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.618567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.618845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.619277 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.624750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.629894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:42.630757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.631374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.631655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.631952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.632604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.634080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:42.634842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:42.635835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:42.636576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 40/81] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:42.637224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.664397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 42/82] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:44:42 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:42.665151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.754114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7844e0-3d4d-4edc-a857-3876ba9e5161 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.775679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.795606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.796601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.796601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.796887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.798067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.799575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.801313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 41/83] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:42.805441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:42.807145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0f43-722e-480d-97db-e7b9eb6551f2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.850162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.850711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.850989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.851961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:42.917870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:42.924880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5255-aa76-4a23-a8e3-77ae70ee7e83 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:42.942630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:42.944485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:42.969054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:42.969686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:42.969963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:42.970232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.035074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:43.056437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.057930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.075288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:43.076245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.178830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 42/85] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:43.184142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.187302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:43.208470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c62b34-4dfa-48b0-81eb-9c87a6c401d7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:43.257976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:43.258611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:43.258892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:43.259166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.260457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:43.260923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.262975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.275305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 44/86] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:43.276503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.284731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:43.308529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e10d1-f89d-46f6-8fde-43ad8031e43b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:43.357015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:43.357640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:43.357914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:43.358177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.390302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97841ef-a5d9-4438-af38-95b077e3c4e5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:43.425861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:43.426732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:43.427214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:43.427667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.432039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.433786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.445612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 45/87] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:43.446397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.446959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.448041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.474362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:43.543691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:43.560651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 43/88] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:43.561963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.584711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a98b-dabd-45ff-ad18-a76299c216a8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:43.621733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:43.622755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:43.623221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:43.623674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.625460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.627182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.629080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 46/89] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:43.634750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.690869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d390c8e-06eb-4fa9-b12a-8aeacc64a9a4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:43.725193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:43.738363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:43.739007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:43.739279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:43.739540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.740897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.742188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.747031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9265e2-d14d-48be-9784-78a7531adf6c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:43.748430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 44/90] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:43.749295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.800879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:43.801500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:43.801775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:43.802041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.802772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=e74cf16638b84fdcb3063b017c210c9d) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:43.803073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.804561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.810577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 47/91] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/role_assignments?user.id=e74cf16638b84fdcb3063b017c210c9d&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:43.816949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:43.818748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:43.876538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea6d06-02e0-4810-8fa6-aa60f4d915ea None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:43.919496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:43.920588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:43.921066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:43.921685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:43.924196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:43.926362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:43.928361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 45/92] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:43.929523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:44.065739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22caae3-ca36-4686-ab45-fbaf8eb9e646 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:44.076466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a947d-6597-4109-8ad6-6d4df57cbe75 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:44.103462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:44.119473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:44.120603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:44.121069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:44.121168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:44.121671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:44.121843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:44.122101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:44.122372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:44.123229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=17b7b5c47aea4b82aa33ed48b84ce909) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:44.123754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:44.125620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:44.132496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 48/93] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/role_assignments?user.id=17b7b5c47aea4b82aa33ed48b84ce909&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:44.133548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:44.167931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:44.268839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:44.271098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:44.320237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f27b0c-1fcb-45ec-b2da-21563ba161c0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:44.416955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:44.417741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:44.418060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:44.418305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:44.419057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] RBAC: Adding query filter params (role.id=8bb219ecae85425b811774a579941e97, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=17b7b5c47aea4b82aa33ed48b84ce909) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:44.419367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:44.420863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:44.434902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 49/94] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:44 2022] GET /identity/v3/role_assignments?user.id=17b7b5c47aea4b82aa33ed48b84ce909&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=8bb219ecae85425b811774a579941e97 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:44.491048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 46/95] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:44.497186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:44.619469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:44.650161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5536c6-cbf2-416d-8da5-8ba2ebe1d5d8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:44.688062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4168a-3a95-4727-9d33-5498e61d7285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:44.688880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4168a-3a95-4727-9d33-5498e61d7285 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:44.689165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4168a-3a95-4727-9d33-5498e61d7285 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:44.689443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4168a-3a95-4727-9d33-5498e61d7285 None admin] PATH_INFO: `/v3/projects/b9c3bae3230f406085fa7b04455d0009` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:44.690606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4168a-3a95-4727-9d33-5498e61d7285 None admin] RBAC: Authorizing `identity:get_project(project_id=b9c3bae3230f406085fa7b04455d0009)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:44.692113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4168a-3a95-4727-9d33-5498e61d7285 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:44.698874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 50/96] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:44 2022] GET /identity/v3/projects/b9c3bae3230f406085fa7b04455d0009 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:44.700441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:44.747166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:44.838280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663099-d637-41d1-b6d0-cb90247c4e6f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:44.873725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2ccf8-3a0a-415c-8a90-7db445bff330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:44.874264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2ccf8-3a0a-415c-8a90-7db445bff330 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:44.874606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2ccf8-3a0a-415c-8a90-7db445bff330 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:44.874883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2ccf8-3a0a-415c-8a90-7db445bff330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:44.875675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2ccf8-3a0a-415c-8a90-7db445bff330 None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=b9c3bae3230f406085fa7b04455d0009, user.id=17b7b5c47aea4b82aa33ed48b84ce909) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:44.876015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2ccf8-3a0a-415c-8a90-7db445bff330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:44.877481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2ccf8-3a0a-415c-8a90-7db445bff330 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:44.883619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 47/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:44 2022] GET /identity/v3/role_assignments?user.id=17b7b5c47aea4b82aa33ed48b84ce909&scope.project.id=b9c3bae3230f406085fa7b04455d0009&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:45.303244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42334-1140-4210-8777-eccbf6cbc6f3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:45.303434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42334-1140-4210-8777-eccbf6cbc6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:45.303728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c42334-1140-4210-8777-eccbf6cbc6f3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:45.305650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 51/98] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:45.310643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2fba-1349-4d04-bc3f-cf19a121c950 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:45.311475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2fba-1349-4d04-bc3f-cf19a121c950 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:45.312124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2fba-1349-4d04-bc3f-cf19a121c950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:45.340846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8fbb2fba-1349-4d04-bc3f-cf19a121c950 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:45.342389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8fbb2fba-1349-4d04-bc3f-cf19a121c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:45.421681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 48/99] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:45.597548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720b2a-6725-493e-8111-1e0191c1ec4a None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:45.598177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720b2a-6725-493e-8111-1e0191c1ec4a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:45.598177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720b2a-6725-493e-8111-1e0191c1ec4a None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:45.599491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 52/100] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:45.604921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c62356-0644-42d7-bbc5-dadb2b4435c6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:45.605443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c62356-0644-42d7-bbc5-dadb2b4435c6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:45.605930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c62356-0644-42d7-bbc5-dadb2b4435c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:45.628259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-39c62356-0644-42d7-bbc5-dadb2b4435c6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:45.629755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-39c62356-0644-42d7-bbc5-dadb2b4435c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:45.646208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:45.720569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:45.876049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20720b2a-6725-493e-8111-1e0191c1ec4a None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:46.015954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20720b2a-6725-493e-8111-1e0191c1ec4a None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:46.063771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:46.064768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:46.065243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:46.065736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:46.067037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:46.068796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:46.070582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 53/102] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:46.076769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c62356-0644-42d7-bbc5-dadb2b4435c6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:46.169587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:46.204291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:46.239420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c62356-0644-42d7-bbc5-dadb2b4435c6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:46.287361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:46.288023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:46.288301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:46.288572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:46.289222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:46.290683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:46.342969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:46.354903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 50/103] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:44:46 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:46.402682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e47b5-5654-4978-88a1-00df8bd756d2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:46.471265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:46.471957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:46.472236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:46.472505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:46.492697 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:46.498119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:46.498952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:46.500240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 54/104] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:44:46.507455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:46.633066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff3cbb-1a0c-4a9f-87bf-23abae14caa1 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:46.671144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:46.672037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:46.672317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:46.672684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:46.673379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:46.673685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:46.675097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:46.684329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 51/105] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:46.692941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:46.816663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:46.858588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e593dc-a59f-48e1-89a7-18d5e013c0d4 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:46.897996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41ebd3-22b4-42a8-bec4-2a70653b009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:46.898665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41ebd3-22b4-42a8-bec4-2a70653b009a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:46.898939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41ebd3-22b4-42a8-bec4-2a70653b009a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:46.899208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41ebd3-22b4-42a8-bec4-2a70653b009a None admin] PATH_INFO: `/v3/users/0ce622d272a84a8ab7e97303496ab44c` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:46.919351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41ebd3-22b4-42a8-bec4-2a70653b009a None admin] RBAC: Authorizing `identity:get_user(user_id=0ce622d272a84a8ab7e97303496ab44c)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:46.920998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41ebd3-22b4-42a8-bec4-2a70653b009a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:46.922936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 55/106] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:46 2022] GET /identity/v3/users/0ce622d272a84a8ab7e97303496ab44c => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:46.928719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:47.037270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:47.062123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b03f75-d026-452c-9b60-e5b367c53aee None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.062414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b03f75-d026-452c-9b60-e5b367c53aee None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.062695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b03f75-d026-452c-9b60-e5b367c53aee None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.064239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 56/107] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:44:47.067192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3238-8a06-4258-8b89-e7114b5160b3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.067474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3238-8a06-4258-8b89-e7114b5160b3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.067790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b3238-8a06-4258-8b89-e7114b5160b3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.069012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 57/108] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:44:47.072855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b658-6b03-4ff4-a6a1-dd538a38c23b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.073137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b658-6b03-4ff4-a6a1-dd538a38c23b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.073408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1b658-6b03-4ff4-a6a1-dd538a38c23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.092125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-34d1b658-6b03-4ff4-a6a1-dd538a38c23b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:47.093523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-34d1b658-6b03-4ff4-a6a1-dd538a38c23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:47.110986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8bdf-3f39-4f5c-aa64-e670577f9ea0 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:47.181309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:47.181943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.182224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.182501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.232971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 58/109] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:47.234887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b85c-bbc0-4d5f-be4f-6dfe32483d0b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.236726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b85c-bbc0-4d5f-be4f-6dfe32483d0b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.237256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b85c-bbc0-4d5f-be4f-6dfe32483d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.275793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-bb53b85c-bbc0-4d5f-be4f-6dfe32483d0b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:47.278561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bb53b85c-bbc0-4d5f-be4f-6dfe32483d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:47.305870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:47.307659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:47.368787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:47.414093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 52/110] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:47.420924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:47.428880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:47.469748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 59/111] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:47.575352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a07b0a-e959-4ba5-af7b-4454ed94e7ea None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:47.588806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b85c-bbc0-4d5f-be4f-6dfe32483d0b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:47.650703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:47.651862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.652341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.652805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.656845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:47.658661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:47.660882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 53/112] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:47 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:47.666874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:47.739017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:47.751128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b85c-bbc0-4d5f-be4f-6dfe32483d0b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:47.810188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:47.811783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.812210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.812481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.838434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:47.845825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:47.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:47.847424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:47.850017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 60/113] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:47.851045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:47.870726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02517be-47b0-4c0f-bc4b-26711335dce3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:47.909403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:47.910089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:47.910371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:47.910641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:47.911390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] RBAC: Adding query filter params (role.id=88530fd398e84e9fa2d058a50b2ee980, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=0ce622d272a84a8ab7e97303496ab44c) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:47.911716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:47.913300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:47.919811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 54/114] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:47 2022] GET /identity/v3/role_assignments?user.id=0ce622d272a84a8ab7e97303496ab44c&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=88530fd398e84e9fa2d058a50b2ee980 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:47.920684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:47.985227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:48.076395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:48.087655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472358b0-d435-4063-9732-b859991e7e48 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.107130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9fec-d661-4b62-be98-7ca6da85a8ac None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.134416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367260d-88fc-4c0c-b4d1-46bf71b5d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.137019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367260d-88fc-4c0c-b4d1-46bf71b5d7de None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.137577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367260d-88fc-4c0c-b4d1-46bf71b5d7de None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.137851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367260d-88fc-4c0c-b4d1-46bf71b5d7de None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.138537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367260d-88fc-4c0c-b4d1-46bf71b5d7de None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:48.138838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367260d-88fc-4c0c-b4d1-46bf71b5d7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:48.142190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367260d-88fc-4c0c-b4d1-46bf71b5d7de None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:48.159776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 55/115] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:48.161063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aafb4-4aa8-4ac1-8fb1-e38bc3e684bc None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.161345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aafb4-4aa8-4ac1-8fb1-e38bc3e684bc None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.161615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aafb4-4aa8-4ac1-8fb1-e38bc3e684bc None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.162801 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 56/116] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:48.168455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fece4-136d-40a1-8205-5e8482cce13c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.168732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fece4-136d-40a1-8205-5e8482cce13c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.169021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fece4-136d-40a1-8205-5e8482cce13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.179221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.180190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.180666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.181134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.188437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9e5fece4-136d-40a1-8205-5e8482cce13c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:48.189621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9e5fece4-136d-40a1-8205-5e8482cce13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:48.212886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:48.218015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:48.219021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:48.219789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 61/117] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:48.222933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:48.295431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 57/118] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:48.296445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fece4-136d-40a1-8205-5e8482cce13c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:48.395254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:48.412655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fece4-136d-40a1-8205-5e8482cce13c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.457360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.457995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.458270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.458539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.459210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:48.459504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:48.460989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:48.475098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 58/119] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:48.480363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:48.481399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9c61-d16c-4736-a803-fd0631044172 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.504067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:48.566056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779301f0-3d0f-4ef1-a116-8185d8e9a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.566709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779301f0-3d0f-4ef1-a116-8185d8e9a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.566991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779301f0-3d0f-4ef1-a116-8185d8e9a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.567262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779301f0-3d0f-4ef1-a116-8185d8e9a9a3 None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.572406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779301f0-3d0f-4ef1-a116-8185d8e9a9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:48.573901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779301f0-3d0f-4ef1-a116-8185d8e9a9a3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:48.575543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 62/120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:48 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:48.576870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68629697-781b-4a7d-a7d7-c60a67bf3ee6 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.577154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68629697-781b-4a7d-a7d7-c60a67bf3ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.577427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68629697-781b-4a7d-a7d7-c60a67bf3ee6 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.578668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 63/121] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:48.589172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f07f-98b5-43cf-a924-f346c9ba9b51 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.589460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f07f-98b5-43cf-a924-f346c9ba9b51 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.589735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f07f-98b5-43cf-a924-f346c9ba9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.590079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f98ea-558b-4ca1-9d77-8212e7307fd6 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.629147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e3a8f07f-98b5-43cf-a924-f346c9ba9b51 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:48.630835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e3a8f07f-98b5-43cf-a924-f346c9ba9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:48.634014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.634665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.634938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.635204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] PATH_INFO: `/v3/users/e74cf16638b84fdcb3063b017c210c9d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.636346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] RBAC: Authorizing `identity:get_user(user_id=e74cf16638b84fdcb3063b017c210c9d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:48.637794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:48.639509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 59/122] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:48 2022] GET /identity/v3/users/e74cf16638b84fdcb3063b017c210c9d => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:48.640193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:48.660939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:48.715091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 64/123] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:48.716473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8f07f-98b5-43cf-a924-f346c9ba9b51 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:48.778876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae9f65-cd42-4123-8c11-bdb2f2748c44 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.835786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.836809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.837285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.837753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.839092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:48.840802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:48.842755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 60/124] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:48 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:48.843850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:48.906369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8f07f-98b5-43cf-a924-f346c9ba9b51 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.923841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:48.932139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:48.947597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516ae5b-16f3-4647-98ef-b7993dda6495 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:48.974765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.975416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.975777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.975992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:48.980530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:48.982199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:48.983360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:48.984285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 65/125] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:48 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:48.984684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:48.985132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:48.985383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:48.985949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.015323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:49.021318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:49.022178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:49.022942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:49.028502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 61/126] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:44:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:49.029419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.125993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfafb4f-b466-4245-bc76-46508cd1299d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.146061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570bbab-3193-4c18-b04e-a386c6e8620c None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.160306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.160975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.161251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.161518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/17b7b5c47aea4b82aa33ed48b84ce909/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.163655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a78b258ad24b42b5759483dd69f2ff, user_id=17b7b5c47aea4b82aa33ed48b84ce909, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:49.165191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:49.184169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 66/127] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:44:48 2022] PUT /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/17b7b5c47aea4b82aa33ed48b84ce909/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:44:49.184728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.188589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.189613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.190098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.190565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/e74cf16638b84fdcb3063b017c210c9d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.193208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a78b258ad24b42b5759483dd69f2ff, user_id=e74cf16638b84fdcb3063b017c210c9d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:49.195017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:49.216793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 62/128] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:44:49 2022] PUT /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/e74cf16638b84fdcb3063b017c210c9d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:44:49.218147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.222114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:49.285035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:49.342528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0711f08-6c75-4002-8983-a7bf3387afae None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.384260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.386276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.386763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.387228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.388264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:49.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:49.391122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:49.402218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 63/129] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:44:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:49.409222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.464417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b69f3-eecf-43a8-ab2c-9f37303ed4ee None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.538005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.538718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.538995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.539259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.542266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:49.571737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:49.575159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:49.576267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:49.577307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:49.580904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 67/130] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:49.587134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.614032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810680-5cff-4915-a379-d2e2373f60f0 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.654540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.655340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.655898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.656353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.657812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:49.659377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:49.661709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 64/131] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:49 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:49.667611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.695604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:49.701684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c9814-32af-4803-9558-090e0ef6ab77 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.750869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504df266-daae-4a12-94a3-a04a8a59e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.751503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df266-daae-4a12-94a3-a04a8a59e2ed None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.751806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df266-daae-4a12-94a3-a04a8a59e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.752081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df266-daae-4a12-94a3-a04a8a59e2ed None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.752762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504df266-daae-4a12-94a3-a04a8a59e2ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:49.753064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504df266-daae-4a12-94a3-a04a8a59e2ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:49.754475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504df266-daae-4a12-94a3-a04a8a59e2ed None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:49.766824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 68/132] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:49.768129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df181d7-dd97-4826-9ccc-e87ab56b308b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.768512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df181d7-dd97-4826-9ccc-e87ab56b308b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.768787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df181d7-dd97-4826-9ccc-e87ab56b308b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.769986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 69/133] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:49.775879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daae73-5852-430b-8485-f2a06de75804 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.776167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daae73-5852-430b-8485-f2a06de75804 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.776489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daae73-5852-430b-8485-f2a06de75804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.784637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086da1f-00ca-4796-8c31-2d3e63c6eb4d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.795868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-14daae73-5852-430b-8485-f2a06de75804 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:49.797403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-14daae73-5852-430b-8485-f2a06de75804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:49.815411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:49.820729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.821618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.822232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.822572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.824262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:49.826116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:49.831473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 65/134] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:49 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:49.831473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.906642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 70/135] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:49.908182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daae73-5852-430b-8485-f2a06de75804 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:49.938559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8e3a8-d7e4-4238-a4bf-95a6d0894efd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:49.974246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:49.974902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:49.975246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:49.975580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:49.976799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:49.978560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:49.981186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 66/136] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:49 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:49.987182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:50.104212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:50.120959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:50.128207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daae73-5852-430b-8485-f2a06de75804 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:50.195690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942796-2552-4a6a-ba15-036bda708550 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:50.201111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:50.201848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:50.202121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:50.202651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/17b7b5c47aea4b82aa33ed48b84ce909/roles/8bb219ecae85425b811774a579941e97` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:50.213997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a78b258ad24b42b5759483dd69f2ff, user_id=17b7b5c47aea4b82aa33ed48b84ce909, role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:50.216305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:50.251246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:44:49 2022] PUT /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/17b7b5c47aea4b82aa33ed48b84ce909/roles/8bb219ecae85425b811774a579941e97 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:44:50.270436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:50.271097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:50.271377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:50.271645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] PATH_INFO: `/v3/projects/b9c3bae3230f406085fa7b04455d0009` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:50.276593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] RBAC: Authorizing `identity:get_project(project_id=b9c3bae3230f406085fa7b04455d0009)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:50.278081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:50.280166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 67/138] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:49 2022] GET /identity/v3/projects/b9c3bae3230f406085fa7b04455d0009 => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:50.286311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:50.314522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:50.438184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f758d8-141d-4a6b-b64b-33a1324639af None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:50.481031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:50.481680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:50.481952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:50.482221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:50.485844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:50.488851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:50.490490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 68/139] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:50.502438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:50.508034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:50.528874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6fdd6-3a90-48bd-b449-cb1562241027 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:50.585852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03694d-9448-4e4a-b0fa-320ee56492f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:50.586542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03694d-9448-4e4a-b0fa-320ee56492f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:50.586825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03694d-9448-4e4a-b0fa-320ee56492f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:50.587098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03694d-9448-4e4a-b0fa-320ee56492f8 None admin] PATH_INFO: `/v3/projects/b9c3bae3230f406085fa7b04455d0009/users/17b7b5c47aea4b82aa33ed48b84ce909/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:50.593411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03694d-9448-4e4a-b0fa-320ee56492f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9c3bae3230f406085fa7b04455d0009, user_id=17b7b5c47aea4b82aa33ed48b84ce909, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:50.594904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03694d-9448-4e4a-b0fa-320ee56492f8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:50.617933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a15a8-244a-42a4-9fc9-452c1c41fd05 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:50.630945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 72/140] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:44:50 2022] PUT /identity/v3/projects/b9c3bae3230f406085fa7b04455d0009/users/17b7b5c47aea4b82aa33ed48b84ce909/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:44:50.671565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624f517-0648-4e5a-b68c-123cc9bdd7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:50.672242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624f517-0648-4e5a-b68c-123cc9bdd7ae None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:50.672528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624f517-0648-4e5a-b68c-123cc9bdd7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:50.672792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624f517-0648-4e5a-b68c-123cc9bdd7ae None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:50.673469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624f517-0648-4e5a-b68c-123cc9bdd7ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:50.674965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624f517-0648-4e5a-b68c-123cc9bdd7ae None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:50.722358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 69/141] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:44:50 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:44:50.775333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6211f-6863-42a9-b727-dc090730d384 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:50.775630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6211f-6863-42a9-b727-dc090730d384 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:50.775821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6211f-6863-42a9-b727-dc090730d384 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:50.777298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 73/142] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:50.787220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7474-ac20-4d6a-a7b5-f12fe5fcaa0b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:50.787530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7474-ac20-4d6a-a7b5-f12fe5fcaa0b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:50.787785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7474-ac20-4d6a-a7b5-f12fe5fcaa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:50.813667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-143d7474-ac20-4d6a-a7b5-f12fe5fcaa0b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:50.814913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-143d7474-ac20-4d6a-a7b5-f12fe5fcaa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:50.900132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:50.910794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:51.226513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6211f-6863-42a9-b727-dc090730d384 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:51.238286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:51.372411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6211f-6863-42a9-b727-dc090730d384 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:51.416106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:51.416756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:51.417046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:51.417315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:51.434149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:51.439172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:51.440015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:51.441246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 74/144] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:51.446167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7474-ac20-4d6a-a7b5-f12fe5fcaa0b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:51.609956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7474-ac20-4d6a-a7b5-f12fe5fcaa0b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:51.652616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:51.653239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:51.653522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:51.653783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:51.654452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:51.654752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:51.656327 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:51.665633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 71/145] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:51.671315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:51.757072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:51.799619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba435c-3b76-4d8d-965a-7c91717deef2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:51.838790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:51.839437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:51.839750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:51.839999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] PATH_INFO: `/v3/users/0ce622d272a84a8ab7e97303496ab44c` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:51.841129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] RBAC: Authorizing `identity:get_user(user_id=0ce622d272a84a8ab7e97303496ab44c)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:51.842607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:51.845201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 75/146] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:51 2022] GET /identity/v3/users/0ce622d272a84a8ab7e97303496ab44c => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:51.850690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:51.964172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:52.051797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9ea72-4dcc-454e-b903-faff4702a729 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:52.094090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c7e3b-7655-4ac2-ae37-10eb3d23f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:52.094833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c7e3b-7655-4ac2-ae37-10eb3d23f05f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:52.095108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c7e3b-7655-4ac2-ae37-10eb3d23f05f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:52.095367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c7e3b-7655-4ac2-ae37-10eb3d23f05f None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:52.096557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c7e3b-7655-4ac2-ae37-10eb3d23f05f None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:52.098012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c7e3b-7655-4ac2-ae37-10eb3d23f05f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:52.099912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 72/147] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:51 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:52.105636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:52.260187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4243-4bc5-4c1f-91a1-fe784c52a589 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:52.304501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187b02d-6334-4656-9321-d735cee2ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:52.305541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187b02d-6334-4656-9321-d735cee2ab3c None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:52.306008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187b02d-6334-4656-9321-d735cee2ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:52.306467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187b02d-6334-4656-9321-d735cee2ab3c None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/0ce622d272a84a8ab7e97303496ab44c/roles/88530fd398e84e9fa2d058a50b2ee980` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:52.308637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187b02d-6334-4656-9321-d735cee2ab3c None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a78b258ad24b42b5759483dd69f2ff, user_id=0ce622d272a84a8ab7e97303496ab44c, role_id=88530fd398e84e9fa2d058a50b2ee980)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:52.310294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187b02d-6334-4656-9321-d735cee2ab3c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:52.314324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:52.338384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 76/148] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:44:52 2022] PUT /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/users/0ce622d272a84a8ab7e97303496ab44c/roles/88530fd398e84e9fa2d058a50b2ee980 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:44:52.800043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba6410-55c1-427a-a149-7079b8e106a5 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:52.800584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba6410-55c1-427a-a149-7079b8e106a5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:52.800584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba6410-55c1-427a-a149-7079b8e106a5 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:52.801930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 73/149] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:52.808467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6eea-15a2-425f-8b46-93422fe67b3c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:52.809060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6eea-15a2-425f-8b46-93422fe67b3c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:52.809542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd6eea-15a2-425f-8b46-93422fe67b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:52.829753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-93fd6eea-15a2-425f-8b46-93422fe67b3c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:52.831305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-93fd6eea-15a2-425f-8b46-93422fe67b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:52.883513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0955aa-5866-476f-8422-ecf2cceb66b6 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:52.884156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0955aa-5866-476f-8422-ecf2cceb66b6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:52.884647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0955aa-5866-476f-8422-ecf2cceb66b6 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:52.886216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 74/150] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:44:52.892318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7655232-9a8d-4b19-b9b2-f9dd9889306e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:52.892900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7655232-9a8d-4b19-b9b2-f9dd9889306e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:52.893372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7655232-9a8d-4b19-b9b2-f9dd9889306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:52.918135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 77/151] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:52.932809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e7655232-9a8d-4b19-b9b2-f9dd9889306e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:52.934263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e7655232-9a8d-4b19-b9b2-f9dd9889306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:53.030160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 75/152] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:44:53.490668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd6eea-15a2-425f-8b46-93422fe67b3c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:53.619217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7655232-9a8d-4b19-b9b2-f9dd9889306e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:53.623909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd6eea-15a2-425f-8b46-93422fe67b3c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:53.672060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:53.675155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c52eff-8a2e-43cf-ac34-14e909a686b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:53.676091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52eff-8a2e-43cf-ac34-14e909a686b7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:53.676091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52eff-8a2e-43cf-ac34-14e909a686b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:53.676372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52eff-8a2e-43cf-ac34-14e909a686b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:53.692399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c52eff-8a2e-43cf-ac34-14e909a686b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-54c52eff-8a2e-43cf-ac34-14e909a686b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:53.697295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:53.698197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:53.698978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:53.703401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 78/153] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:53.713908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670e37-4ec9-43e1-9c02-60e2b652e8de None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:53.714187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670e37-4ec9-43e1-9c02-60e2b652e8de None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:53.714458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670e37-4ec9-43e1-9c02-60e2b652e8de None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:53.716416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 79/154] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:53.720548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5670e37-4ec9-43e1-9c02-60e2b652e8de None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:53.737435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:53.816802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7655232-9a8d-4b19-b9b2-f9dd9889306e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:53.884676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f042-8837-4b7a-9678-fc1b4f2e1168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:53.885716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f042-8837-4b7a-9678-fc1b4f2e1168 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:53.886285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f042-8837-4b7a-9678-fc1b4f2e1168 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:53.887368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f042-8837-4b7a-9678-fc1b4f2e1168 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:53.905912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5670e37-4ec9-43e1-9c02-60e2b652e8de None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:53.908490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0f042-8837-4b7a-9678-fc1b4f2e1168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-3de0f042-8837-4b7a-9678-fc1b4f2e1168 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:53.919713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:53.920642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:53.921909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:53.929757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 76/155] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:44:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:44:53.931566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23c4f-e424-419b-be35-fe8df1a936f9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:53.932075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23c4f-e424-419b-be35-fe8df1a936f9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:53.932679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23c4f-e424-419b-be35-fe8df1a936f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:53.962024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-32a23c4f-e424-419b-be35-fe8df1a936f9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:53.963630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-32a23c4f-e424-419b-be35-fe8df1a936f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:53.984205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:53.984835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:53.985108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:53.985368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:53.986037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:53.986329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:53.988412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:54.007469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 80/156] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:54.008419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:54.083905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:54.116044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 77/157] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:54.117453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a23c4f-e424-419b-be35-fe8df1a936f9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:54.165004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d27395-38f5-4fbf-bf8e-242f0e9d2945 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:54.205820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:54.221528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:54.222062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:54.222334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:54.222597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:54.223259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:54.223916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:54.225331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:54.241433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 81/158] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:54.251527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:54.337867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a23c4f-e424-419b-be35-fe8df1a936f9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:54.411026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:54.412098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:54.412701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:54.413256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:54.416496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:54.418190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:54.420676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 78/159] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:54 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:54.422488 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2cad-e582-4c60-9911-16cbb2da4486 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:54.426250 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:54.440334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:54.484602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:54.485093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:54.485366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:54.485627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] PATH_INFO: `/v3/users/e74cf16638b84fdcb3063b017c210c9d` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:54.489869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] RBAC: Authorizing `identity:get_user(user_id=e74cf16638b84fdcb3063b017c210c9d)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:54.491511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:54.493356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 82/160] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:54 2022] GET /identity/v3/users/e74cf16638b84fdcb3063b017c210c9d => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:54.505051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:54.627730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2675df-9c78-499f-bb2c-5a6ed469de28 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:54.641705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:54.685418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fabedf-44fa-4291-95da-a689e12cbfab None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:54.688004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:54.688879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:54.689347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:54.689812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:54.774959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec780947-50f4-42e1-9e81-cac31e69347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:54.775986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec780947-50f4-42e1-9e81-cac31e69347b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:54.776461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec780947-50f4-42e1-9e81-cac31e69347b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:54.776909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec780947-50f4-42e1-9e81-cac31e69347b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:54.846115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:54.850238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:54.887528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:54.936069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec780947-50f4-42e1-9e81-cac31e69347b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:54.938227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec780947-50f4-42e1-9e81-cac31e69347b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:55.064809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 79/161] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:44:55.065675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:55.077961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:55.086816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 83/162] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:44:55.091293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe954813-687c-47c1-b4b6-2daeb6b994ad None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.091293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe954813-687c-47c1-b4b6-2daeb6b994ad None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.091293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe954813-687c-47c1-b4b6-2daeb6b994ad None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.091293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 84/163] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:55.092722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a11d8-5a6f-4492-a2a6-83eddacc976f None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.093038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a11d8-5a6f-4492-a2a6-83eddacc976f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.093325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a11d8-5a6f-4492-a2a6-83eddacc976f None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.094476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 85/164] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:55.095166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a11d8-5a6f-4492-a2a6-83eddacc976f None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:55.228645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41841-25c0-4f4f-a673-9ba6ac35e535 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:55.230397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:55.273742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a11d8-5a6f-4492-a2a6-83eddacc976f None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:55.295937 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:55.297471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.297758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.298004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.328732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:55.334272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:55.335122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:44:55.335917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:44:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:55.336885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:55.349369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8cc4a-e48f-4073-a11f-9b7214b18f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:55.350035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8cc4a-e48f-4073-a11f-9b7214b18f3f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.350316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8cc4a-e48f-4073-a11f-9b7214b18f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.350585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8cc4a-e48f-4073-a11f-9b7214b18f3f None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.351737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8cc4a-e48f-4073-a11f-9b7214b18f3f None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:55.353203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8cc4a-e48f-4073-a11f-9b7214b18f3f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:55.354934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:55 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:55.365072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b8db-8ab2-40ca-89a3-b9554570b388 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.365470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b8db-8ab2-40ca-89a3-b9554570b388 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.365800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b8db-8ab2-40ca-89a3-b9554570b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.398777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2e75b8db-8ab2-40ca-89a3-b9554570b388 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:55.401572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2e75b8db-8ab2-40ca-89a3-b9554570b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:55.456329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:55.521772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320a8b-dbf2-4d60-92b4-f89390a43b23 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:55.544611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 87/167] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:55.546730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef67d-4521-48e3-b5d0-334aa5eb8ef3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.547416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef67d-4521-48e3-b5d0-334aa5eb8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.549339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ef67d-4521-48e3-b5d0-334aa5eb8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.580942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a72ef67d-4521-48e3-b5d0-334aa5eb8ef3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:55.583079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a72ef67d-4521-48e3-b5d0-334aa5eb8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:55.590008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:55.591377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.592362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.593133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.595488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:55.599411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:55.601452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 81/168] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:55 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:55.602386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:55.722620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:55.723794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef67d-4521-48e3-b5d0-334aa5eb8ef3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:55.732245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:55.820958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ce97a-f562-4193-9b04-00eebb644428 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:55.868780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:55.870140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.870381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ef67d-4521-48e3-b5d0-334aa5eb8ef3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:55.870798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.871246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.872113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:55.872648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:55.874282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:55.880021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:55.887876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 82/170] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:44:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:55.888614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:55.948433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:55.949056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:55.949332 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:55.949589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:55.950314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=17b7b5c47aea4b82aa33ed48b84ce909) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:55.950642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:55.952202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:55.958638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 89/171] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:55 2022] GET /identity/v3/role_assignments?user.id=17b7b5c47aea4b82aa33ed48b84ce909&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:55.959466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:56.000376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f60ef1-38b0-4293-b851-5613d85f08b5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.037499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.038421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.038943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.039441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.040424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=e74cf16638b84fdcb3063b017c210c9d) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:56.040903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:56.042601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:56.054212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 83/172] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:55 2022] GET /identity/v3/role_assignments?user.id=e74cf16638b84fdcb3063b017c210c9d&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:56.082178 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:56.131187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b01c1-349f-4056-9958-ac24d4bcc32d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.178059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.178726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.178999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.179273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.180577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:56.182229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:56.183887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 90/173] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:55 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:56.190086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:56.212468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:56.304123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:56.378175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cce7-fea8-49c1-80d3-f474e076716c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.392084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0fb2-acde-435d-bf1f-d832819a0fcb None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.420271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bd327-fd53-498c-879c-280632d404ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.421573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bd327-fd53-498c-879c-280632d404ee None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.422050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bd327-fd53-498c-879c-280632d404ee None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.422632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bd327-fd53-498c-879c-280632d404ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.433166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:56.436552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bd327-fd53-498c-879c-280632d404ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-080bd327-fd53-498c-879c-280632d404ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:56.444555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:56.445544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:44:56.446320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:56.447389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8f440-9ecd-4ba9-8060-bb229fbeeb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.447389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f440-9ecd-4ba9-8060-bb229fbeeb51 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.447389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f440-9ecd-4ba9-8060-bb229fbeeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.447389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8f440-9ecd-4ba9-8060-bb229fbeeb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.454915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 91/174] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:44:56.456252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bd327-fd53-498c-879c-280632d404ee None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:56.542871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8f440-9ecd-4ba9-8060-bb229fbeeb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:56.545033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8f440-9ecd-4ba9-8060-bb229fbeeb51 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:56.603691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bd327-fd53-498c-879c-280632d404ee None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.639742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:56.663075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd6f05-7710-47f0-bd8a-6e3e59bdeb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.664326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd6f05-7710-47f0-bd8a-6e3e59bdeb9b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.664874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd6f05-7710-47f0-bd8a-6e3e59bdeb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.665532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd6f05-7710-47f0-bd8a-6e3e59bdeb9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.681395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd6f05-7710-47f0-bd8a-6e3e59bdeb9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:56.687524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 84/175] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:56.688919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974124-7d07-4dd4-9511-531e544f6d20 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-8bdd6f05-7710-47f0-bd8a-6e3e59bdeb9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:56.689029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:56.689842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:44:56.690618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:56.691785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974124-7d07-4dd4-9511-531e544f6d20 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.691785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974124-7d07-4dd4-9511-531e544f6d20 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.691785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 85/176] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:56.691785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974124-7d07-4dd4-9511-531e544f6d20 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:56.694329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 92/177] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:56.697441 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fae3f-640e-4551-9249-3e84de47d836 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.698064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fae3f-640e-4551-9249-3e84de47d836 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.698528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fae3f-640e-4551-9249-3e84de47d836 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.700418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 93/178] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:56.701348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fae3f-640e-4551-9249-3e84de47d836 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:56.770251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:56.798985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974124-7d07-4dd4-9511-531e544f6d20 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.811751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fae3f-640e-4551-9249-3e84de47d836 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.832276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3978fd9-07bc-42b8-8cee-5c72a308624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.833010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3978fd9-07bc-42b8-8cee-5c72a308624c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.833149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3978fd9-07bc-42b8-8cee-5c72a308624c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.833403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3978fd9-07bc-42b8-8cee-5c72a308624c None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.834069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3978fd9-07bc-42b8-8cee-5c72a308624c None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:56.834363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3978fd9-07bc-42b8-8cee-5c72a308624c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:56.835756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3978fd9-07bc-42b8-8cee-5c72a308624c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:56.843887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.849144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 86/179] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:56.849299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.849299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.849299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.849511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3fc6a-4ba8-470b-aca7-e97008547b96 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.849511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3fc6a-4ba8-470b-aca7-e97008547b96 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.849511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3fc6a-4ba8-470b-aca7-e97008547b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.849688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:56.849688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:56.849688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 94/180] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:56 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:56.850231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:56.867334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d5f3fc6a-4ba8-470b-aca7-e97008547b96 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:56.868540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d5f3fc6a-4ba8-470b-aca7-e97008547b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:56.886019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:56.933921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 87/181] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:56.935081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc21fba-d351-418a-aeec-043d6818c52c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.935364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc21fba-d351-418a-aeec-043d6818c52c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.935616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc21fba-d351-418a-aeec-043d6818c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.952598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cbb2af-d131-4674-9e86-d7c63dfc4b6d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:56.953139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4bc21fba-d351-418a-aeec-043d6818c52c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:56.954317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4bc21fba-d351-418a-aeec-043d6818c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:56.980291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:56.990347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695f281-2cb9-4c92-88c4-9cb08a195e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:56.990965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695f281-2cb9-4c92-88c4-9cb08a195e76 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:56.991268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695f281-2cb9-4c92-88c4-9cb08a195e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:56.991534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695f281-2cb9-4c92-88c4-9cb08a195e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:56.992225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695f281-2cb9-4c92-88c4-9cb08a195e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:56.992522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695f281-2cb9-4c92-88c4-9cb08a195e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:56.993916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695f281-2cb9-4c92-88c4-9cb08a195e76 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:57.002313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 95/182] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:57.008054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be58e-ae19-4671-92c0-eaab7dd7f3a3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.008336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be58e-ae19-4671-92c0-eaab7dd7f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.008607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be58e-ae19-4671-92c0-eaab7dd7f3a3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.009970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 96/183] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:44:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:44:57.010587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be58e-ae19-4671-92c0-eaab7dd7f3a3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.029344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 88/184] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:57.030289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc21fba-d351-418a-aeec-043d6818c52c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.125500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be58e-ae19-4671-92c0-eaab7dd7f3a3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.142384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.162548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc21fba-d351-418a-aeec-043d6818c52c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.163595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.164771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.165297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.165572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] PATH_INFO: `/v3/users/17b7b5c47aea4b82aa33ed48b84ce909` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.166702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] RBAC: Authorizing `identity:get_user(user_id=17b7b5c47aea4b82aa33ed48b84ce909)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:57.168256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:57.169948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 97/185] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/users/17b7b5c47aea4b82aa33ed48b84ce909 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:57.175281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.207994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9cd1c-faf0-4947-9005-d3a534f4abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.208530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cd1c-faf0-4947-9005-d3a534f4abcc None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.208800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cd1c-faf0-4947-9005-d3a534f4abcc None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.209058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cd1c-faf0-4947-9005-d3a534f4abcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.209771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9cd1c-faf0-4947-9005-d3a534f4abcc None admin] RBAC: Adding query filter params (role.id=8bb219ecae85425b811774a579941e97, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=17b7b5c47aea4b82aa33ed48b84ce909) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:57.210066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9cd1c-faf0-4947-9005-d3a534f4abcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:57.211498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9cd1c-faf0-4947-9005-d3a534f4abcc None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:57.217392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 89/186] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/role_assignments?user.id=17b7b5c47aea4b82aa33ed48b84ce909&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=8bb219ecae85425b811774a579941e97 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:57.221013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f7eb-b068-405d-b393-8d1c7d132c72 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.221295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f7eb-b068-405d-b393-8d1c7d132c72 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.222993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f7eb-b068-405d-b393-8d1c7d132c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.242327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.244237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f454f7eb-b068-405d-b393-8d1c7d132c72 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:44:57.245597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f454f7eb-b068-405d-b393-8d1c7d132c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:44:57.309796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200319f-14c7-45f6-8b32-701b172ab268 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.332006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 90/187] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:44:57.333201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f7eb-b068-405d-b393-8d1c7d132c72 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.356447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.357715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.357989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.358580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] PATH_INFO: `/v3/users/eef803695d3143ce8d990d0f67fc3173` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.379980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=eef803695d3143ce8d990d0f67fc3173)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:57.382008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:57.384396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 98/188] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/users/eef803695d3143ce8d990d0f67fc3173 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:57.385424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.432304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.464205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f7eb-b068-405d-b393-8d1c7d132c72 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.509854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.510810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.510913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bacaa-ee70-44af-b33d-5a92e06da6a8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.511356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.511844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.531547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.557068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.557705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.557978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.558243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.569817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:57.574832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:57.575733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 99/189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:57.582042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.597803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:57.599350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:57.680017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.685927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5538-94d0-4367-a308-4863622ded75 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.702219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 91/190] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:57.703043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.724074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.724630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.724906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.725194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.735848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:44:57.741052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:44:57.741945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:44:57.742729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 100/191] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:44:57.743361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.777361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.803252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c70d-310d-4dac-b576-a1c32e2c6a67 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.837587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.838192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.838472 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.838740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.841860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b5ac0-f3cd-4ca9-b756-cf9c3ecdd82a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:57.876835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:57.877434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:57.877704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:57.877967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:57.878613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:57.878907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:57.880321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:57.884893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.888258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 101/192] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:57.893153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:57.911058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:57.912540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:57.985249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:57.991937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2faa1-1603-4e76-80db-f5412b526d99 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.015628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 92/193] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:58.016483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.026240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.026907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.027186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.027570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.028927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.030434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.032258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 102/194] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:44:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.033004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.099922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:58.121993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89e063-7503-4fe1-96c7-6a3a1e129c78 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.134614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c27ef-cfac-4abf-bfa7-5bcf7ecdf4ac None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.155600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.156438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.156707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.156975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] PATH_INFO: `/v3/projects/b9c3bae3230f406085fa7b04455d0009` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.158254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=b9c3bae3230f406085fa7b04455d0009)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.159729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.161686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 93/195] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/projects/b9c3bae3230f406085fa7b04455d0009 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.162446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.174137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.174787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.175065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.175304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.176004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:58.176296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.177677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.185850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 103/196] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.186859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.214549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:58.269654 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a56d-b0c7-4b44-8fd7-9bcaa52d4ed5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.286580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d961e-a361-4a36-8ec9-13c81fffb079 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.302940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.303592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.303893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.304166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] PATH_INFO: `/v3/users/0ce622d272a84a8ab7e97303496ab44c` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.305299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] RBAC: Authorizing `identity:get_user(user_id=0ce622d272a84a8ab7e97303496ab44c)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.306834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.308485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 94/197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/users/0ce622d272a84a8ab7e97303496ab44c => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.309236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.325742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:58.330016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.330659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.330933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.331198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.332337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.333796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.335465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 104/198] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.336245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.416118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dadb7b-48f9-475f-a86b-bda33a251a99 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.431460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:58.440587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02904-e35a-4f53-a274-b4d1878c6cd7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.449921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.450541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.451061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.451061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.451752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.453349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.474610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.475226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.475407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 95/199] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:44:58 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:44:58.475513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.475799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.476258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.476590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=b9c3bae3230f406085fa7b04455d0009, user.id=17b7b5c47aea4b82aa33ed48b84ce909) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:58.476840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.478303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.484930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 105/200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/role_assignments?user.id=17b7b5c47aea4b82aa33ed48b84ce909&scope.project.id=b9c3bae3230f406085fa7b04455d0009&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.485807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.577644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:58.621599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad46c8-4833-4198-aa16-0f8f26054f74 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.624491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c183-b30e-4792-a99f-2fbf43bcae80 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.667660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.668335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.668615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.668885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.672581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.673485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.673901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.674333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] PATH_INFO: `/v3/users/eef803695d3143ce8d990d0f67fc3173` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.676197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] RBAC: Authorizing `identity:get_user(user_id=eef803695d3143ce8d990d0f67fc3173)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.677843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.679857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 96/201] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/users/eef803695d3143ce8d990d0f67fc3173 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.680775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.706015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:58.758425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.759956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.803086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b613a04-3420-4982-9140-250a94cc1717 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:58.840861 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:58.841536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:58.841849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:58.842179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:58.843125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=eef803695d3143ce8d990d0f67fc3173) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:58.843514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:58.846053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:58.852706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 97/202] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/role_assignments?user.id=eef803695d3143ce8d990d0f67fc3173&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:58.853583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.856548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:58.889005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 106/203] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:58.895102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:58.969677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:59.038782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8612f26-d072-46e7-86a3-265527104df8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:59.043279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f38b9-2088-4cf4-b026-423fb906ba0c None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:59.116773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:59.117424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:59.117706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:59.117966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:59.119665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:59.120309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:59.120577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:59.120838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:59.121996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:59.123467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:59.125212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 107/204] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:44:59.141698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:59.253405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:59.254880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:59.261241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:59.308322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a9ab-078a-4d5f-9346-4b71364f316b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:59.335354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:59.348569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:59.349188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:59.349461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:59.349721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:59.350675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] RBAC: Adding query filter params (role.id=88530fd398e84e9fa2d058a50b2ee980, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff, user.id=0ce622d272a84a8ab7e97303496ab44c) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:59.350976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:59.353407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:59.365105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 108/205] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:59 2022] GET /identity/v3/role_assignments?user.id=0ce622d272a84a8ab7e97303496ab44c&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=88530fd398e84e9fa2d058a50b2ee980 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:59.452659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 98/206] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:44:59.458862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:59.614295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7617b48-edda-41b9-80d5-00b58dd82ce8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:59.659564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f982-d74b-42d3-9702-ba52677e6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:59.660232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f982-d74b-42d3-9702-ba52677e6317 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:59.660506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f982-d74b-42d3-9702-ba52677e6317 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:59.660772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f982-d74b-42d3-9702-ba52677e6317 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:59.661890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f982-d74b-42d3-9702-ba52677e6317 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:59.663467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f982-d74b-42d3-9702-ba52677e6317 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:59.665448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 109/207] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:44:59 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:44:59.671357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:44:59.804163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952580-b678-49f8-86b3-730abaef7a2f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:44:59.805823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:44:59.848733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d6c27-985d-41b2-b6a1-b4b6fb4adb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:44:59.849727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6c27-985d-41b2-b6a1-b4b6fb4adb27 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:44:59.850204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6c27-985d-41b2-b6a1-b4b6fb4adb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:44:59.850667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d6c27-985d-41b2-b6a1-b4b6fb4adb27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:44:59.851592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d6c27-985d-41b2-b6a1-b4b6fb4adb27 None admin] RBAC: Adding query filter params (role.id=8bb219ecae85425b811774a579941e97, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=eef803695d3143ce8d990d0f67fc3173) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:44:59.852323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d6c27-985d-41b2-b6a1-b4b6fb4adb27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:44:59.854063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d6c27-985d-41b2-b6a1-b4b6fb4adb27 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:44:59.864007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 99/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:44:59 2022] GET /identity/v3/role_assignments?user.id=eef803695d3143ce8d990d0f67fc3173&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=8bb219ecae85425b811774a579941e97 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:00.932131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea21a-68de-448a-bb60-04815142d8eb None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:00.932688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea21a-68de-448a-bb60-04815142d8eb None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:00.932688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ea21a-68de-448a-bb60-04815142d8eb None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:00.934168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 110/209] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:00.939363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5e68-0989-4e0d-9979-54f1a016f3ff None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:00.939793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5e68-0989-4e0d-9979-54f1a016f3ff None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:00.939996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef5e68-0989-4e0d-9979-54f1a016f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:00.962509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-91ef5e68-0989-4e0d-9979-54f1a016f3ff None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:00.963709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-91ef5e68-0989-4e0d-9979-54f1a016f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:01.000641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133f57-584e-481d-bfe0-2f0b17d12ff9 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.000978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133f57-584e-481d-bfe0-2f0b17d12ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.001182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a133f57-584e-481d-bfe0-2f0b17d12ff9 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.002781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 111/210] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:01.007957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f58f-45b1-43af-a6d4-8b3016fb4066 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.008237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f58f-45b1-43af-a6d4-8b3016fb4066 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.008507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f58f-45b1-43af-a6d4-8b3016fb4066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.026878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1391f58f-45b1-43af-a6d4-8b3016fb4066 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:01.028113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1391f58f-45b1-43af-a6d4-8b3016fb4066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:01.032810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 100/211] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:01.096586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:01.107570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 112/212] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:01.267556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ef93c-1c7b-4b70-a7b7-89950615c01d None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.267786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ef93c-1c7b-4b70-a7b7-89950615c01d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.268099 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ef93c-1c7b-4b70-a7b7-89950615c01d None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.269729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 101/213] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:01.274857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268d78b-58d2-4cb8-94a5-dfbccfcb40c0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.275142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268d78b-58d2-4cb8-94a5-dfbccfcb40c0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.275408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268d78b-58d2-4cb8-94a5-dfbccfcb40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.294158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b268d78b-58d2-4cb8-94a5-dfbccfcb40c0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:01.295486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b268d78b-58d2-4cb8-94a5-dfbccfcb40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:01.299406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ef93c-1c7b-4b70-a7b7-89950615c01d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:01.364144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 113/214] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:01.383445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268d78b-58d2-4cb8-94a5-dfbccfcb40c0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:01.400126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:01.407660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ef93c-1c7b-4b70-a7b7-89950615c01d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:01.452828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:01.453620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.453996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.454349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.455620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:01.457279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:01.463662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 102/215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:01.465015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:01.506071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268d78b-58d2-4cb8-94a5-dfbccfcb40c0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:01.528182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:01.549692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:01.550338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.550964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.551240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.563906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:01.571011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:01.572115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:01.572951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:01.574443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e973-b6fe-425e-a002-7cd8477123f7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:01.577310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 114/216] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:01.578153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:01.611931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:01.613054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.613415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.613773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.614513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:01.616717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:01.646784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 103/217] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:01 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:01.652727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:01.678734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:01.717424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e4c3-f542-4ba9-8a88-14a67848dc03 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:01.775121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:01.775774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.776053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.776320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.776995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:01.777290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:01.778756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:01.782523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158338-b28e-4fa8-ba61-2a437b62016a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:01.789108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 115/218] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:01.795014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:01.832127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:01.832799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.833071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.833335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.847207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:01.853739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:01.854608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:01.855372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:01.858619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:01.860060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 104/219] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:01.860910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:01.935584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1875d4-4018-4ff4-960c-164359b199d2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:01.965632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:01.983115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:01.984352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:01.985086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:01.985734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] PATH_INFO: `/v3/users/369a91035fe74aafa4b79e52e14bbeb3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:01.991421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94c6c-ef1b-4818-ab9b-038bad02d084 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:02.003050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] RBAC: Authorizing `identity:get_user(user_id=369a91035fe74aafa4b79e52e14bbeb3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.005217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.007423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 116/220] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:01 2022] GET /identity/v3/users/369a91035fe74aafa4b79e52e14bbeb3 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:02.013211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:02.047931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976620-ae7a-4646-9b7c-3a08b74d9505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:02.048484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976620-ae7a-4646-9b7c-3a08b74d9505 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.048764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976620-ae7a-4646-9b7c-3a08b74d9505 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.049029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976620-ae7a-4646-9b7c-3a08b74d9505 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.049742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976620-ae7a-4646-9b7c-3a08b74d9505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:02.049995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976620-ae7a-4646-9b7c-3a08b74d9505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.052267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976620-ae7a-4646-9b7c-3a08b74d9505 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.064931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 105/221] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:02.066606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad7d3f-a009-414c-96a9-cb1c01c51451 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.067034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad7d3f-a009-414c-96a9-cb1c01c51451 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.067318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad7d3f-a009-414c-96a9-cb1c01c51451 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.069764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 106/222] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:02.072042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad7d3f-a009-414c-96a9-cb1c01c51451 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:02.138925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:02.142553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563cf92-7a8d-4b75-87d7-54c68e0d464c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:02.188267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:02.188895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.189175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.189438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.206753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad7d3f-a009-414c-96a9-cb1c01c51451 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:02.247684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e9f05-5cd6-4a04-8f20-8254371a58b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:02.248356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9f05-5cd6-4a04-8f20-8254371a58b6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.248754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9f05-5cd6-4a04-8f20-8254371a58b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.249032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9f05-5cd6-4a04-8f20-8254371a58b6 None admin] PATH_INFO: `/v3/users/eef803695d3143ce8d990d0f67fc3173` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.250349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e9f05-5cd6-4a04-8f20-8254371a58b6 None admin] RBAC: Authorizing `identity:get_user(user_id=eef803695d3143ce8d990d0f67fc3173)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.251945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e9f05-5cd6-4a04-8f20-8254371a58b6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.253615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 107/223] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:02 2022] GET /identity/v3/users/eef803695d3143ce8d990d0f67fc3173 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:02.259326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a726-df25-49d7-838c-aaef67563b15 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.259611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a726-df25-49d7-838c-aaef67563b15 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.261905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586a726-df25-49d7-838c-aaef67563b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.278911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.280673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.281063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4586a726-df25-49d7-838c-aaef67563b15 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:02.282310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4586a726-df25-49d7-838c-aaef67563b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:02.286201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:02.372064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 108/224] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:02.372958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a726-df25-49d7-838c-aaef67563b15 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:02.391577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:02.396894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 117/225] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:02.403141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:02.505185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586a726-df25-49d7-838c-aaef67563b15 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:02.515249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34162d95-c62b-4b49-ae83-aac28d123248 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:02.547266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:02.548335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.548783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.549210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.550769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.552512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.552782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:02.553553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.553895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.554232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.555452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.555673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 109/226] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:02 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:02.557057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.561356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 118/227] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:02 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:02.564915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:02.568199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:02.577560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:02.676850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61add4b-6e75-4d16-9e3d-5aa4384ddb69 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:02.705583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:02.735880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:02.736554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.736823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.737085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/eef803695d3143ce8d990d0f67fc3173/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.741393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] RBAC: Authorizing `identity:create_grant(project_id=8012cf29932d4c079428afdbfd3d8dff, user_id=eef803695d3143ce8d990d0f67fc3173, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.742855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.769884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 110/228] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:02 2022] PUT /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/eef803695d3143ce8d990d0f67fc3173/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:45:02.770728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f52a1-7ed1-4d1d-94d0-418bfdcb9fc6 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:02.823847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:02.824559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:02.824845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:02.825095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:02.826018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=369a91035fe74aafa4b79e52e14bbeb3) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:02.826359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:02.828230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:02.835624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 119/229] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:02 2022] GET /identity/v3/role_assignments?user.id=369a91035fe74aafa4b79e52e14bbeb3&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:02.852006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:02.931052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:02.972694 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012783d-fcce-49bf-a3d7-4b10a9c7ff83 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:03.013724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:03.014564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:03.014912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:03.015265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:03.027254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:03.033882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:03.034809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:03.035592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:03.036324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 111/230] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:03.041827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:03.170252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccacaf-c9f9-4a9e-887d-dc49090fc838 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:03.216414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:03.229283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:03.230514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:03.230794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:03.231064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:03.231762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:03.232067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:03.234713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:03.251961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 120/231] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:03.257501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:03.389610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f84c-f368-465a-9309-f0eebfba568a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:03.417940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:03.430885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:03.430885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:03.431187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:03.431547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] PATH_INFO: `/v3/users/eef803695d3143ce8d990d0f67fc3173` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:03.437546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] RBAC: Authorizing `identity:get_user(user_id=eef803695d3143ce8d990d0f67fc3173)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:03.437546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:03.444022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 112/232] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:03 2022] GET /identity/v3/users/eef803695d3143ce8d990d0f67fc3173 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:03.452923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:03.622421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d934-1148-4281-98d4-9ade65e5ea4b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:03.676428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b17b4-19a0-48fd-bf7f-4d824992829a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:03.677470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b17b4-19a0-48fd-bf7f-4d824992829a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:03.677967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b17b4-19a0-48fd-bf7f-4d824992829a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:03.678432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b17b4-19a0-48fd-bf7f-4d824992829a None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:03.680454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b17b4-19a0-48fd-bf7f-4d824992829a None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:03.681952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b17b4-19a0-48fd-bf7f-4d824992829a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:03.683632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 121/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:03 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:03.690422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:03.802090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79639b-5b57-4ec6-9a84-6074e05c99d1 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:03.836901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0edc3-62bc-43ed-a045-0832e46e2fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:03.837581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0edc3-62bc-43ed-a045-0832e46e2fa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:03.837853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0edc3-62bc-43ed-a045-0832e46e2fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:03.838117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0edc3-62bc-43ed-a045-0832e46e2fa2 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/eef803695d3143ce8d990d0f67fc3173/roles/8bb219ecae85425b811774a579941e97` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:03.840377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0edc3-62bc-43ed-a045-0832e46e2fa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8012cf29932d4c079428afdbfd3d8dff, user_id=eef803695d3143ce8d990d0f67fc3173, role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:03.841940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0edc3-62bc-43ed-a045-0832e46e2fa2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:03.868137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 113/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:03 2022] PUT /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/eef803695d3143ce8d990d0f67fc3173/roles/8bb219ecae85425b811774a579941e97 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:04.590888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c985-fcce-43b0-81ac-a4dc5ba2cc31 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:04.591409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c985-fcce-43b0-81ac-a4dc5ba2cc31 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:04.591409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c985-fcce-43b0-81ac-a4dc5ba2cc31 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:04.593117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 122/235] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:04.600945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6f7f-db1a-47bf-a41f-480f52bca640 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:04.601815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6f7f-db1a-47bf-a41f-480f52bca640 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:04.602282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6f7f-db1a-47bf-a41f-480f52bca640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:04.605995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293a04c-b1d9-485e-b779-fe7b48818945 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:04.606276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293a04c-b1d9-485e-b779-fe7b48818945 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:04.606542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293a04c-b1d9-485e-b779-fe7b48818945 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:04.607956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 123/236] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:04.613909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8755a-bd16-4697-b99c-c25cb9a9f3be None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:04.614197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8755a-bd16-4697-b99c-c25cb9a9f3be None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:04.614475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8755a-bd16-4697-b99c-c25cb9a9f3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:04.625881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ebdb6f7f-db1a-47bf-a41f-480f52bca640 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:04.627387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ebdb6f7f-db1a-47bf-a41f-480f52bca640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:04.648744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-20c8755a-bd16-4697-b99c-c25cb9a9f3be None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:04.649945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-20c8755a-bd16-4697-b99c-c25cb9a9f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:04.705022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:04.743767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 114/237] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:04.758345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:04.771100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 124/238] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:05.056426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb6f7f-db1a-47bf-a41f-480f52bca640 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:05.147527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8755a-bd16-4697-b99c-c25cb9a9f3be None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:05.202504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb6f7f-db1a-47bf-a41f-480f52bca640 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:05.258682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8755a-bd16-4697-b99c-c25cb9a9f3be None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:05.276980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87293-7569-461b-909b-6d047367287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:05.278001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87293-7569-461b-909b-6d047367287d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.278470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87293-7569-461b-909b-6d047367287d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.278927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87293-7569-461b-909b-6d047367287d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.298432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:05.299079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.299353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.299621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.301626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:05.303106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:05.307465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 125/239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:05.307990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b87293-7569-461b-909b-6d047367287d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:05.313145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-e2b87293-7569-461b-909b-6d047367287d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:05.315141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:05.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:05.316786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:05.323732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 115/240] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:05.323863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87293-7569-461b-909b-6d047367287d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:05.388288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:05.421012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:05.448070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4c3b9-18ef-4291-a772-3c7f6b483b0a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:05.495228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:05.495915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.496196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.496461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.497117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:05.498600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:05.501738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87293-7569-461b-909b-6d047367287d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:05.543320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 126/241] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:05 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:05.545870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205347fc-870a-46c1-8c86-2c6269ad6f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:05.546824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205347fc-870a-46c1-8c86-2c6269ad6f33 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.547326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205347fc-870a-46c1-8c86-2c6269ad6f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.547831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205347fc-870a-46c1-8c86-2c6269ad6f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.548768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205347fc-870a-46c1-8c86-2c6269ad6f33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:05.549287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205347fc-870a-46c1-8c86-2c6269ad6f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:05.550971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205347fc-870a-46c1-8c86-2c6269ad6f33 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:05.561825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 116/242] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:05.568955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:05.726568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674168a-ccda-40a3-905d-006a3ce7b29e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:05.739856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33e58-c0cd-43ee-83a9-47128a574d02 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.740796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33e58-c0cd-43ee-83a9-47128a574d02 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.741264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33e58-c0cd-43ee-83a9-47128a574d02 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.743152 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 117/243] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:05.747094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:05.749081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158795c-43e2-4dc8-9c2a-9b312b8ba9a6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.749648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158795c-43e2-4dc8-9c2a-9b312b8ba9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.750132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158795c-43e2-4dc8-9c2a-9b312b8ba9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.777530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-6158795c-43e2-4dc8-9c2a-9b312b8ba9a6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:05.779150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6158795c-43e2-4dc8-9c2a-9b312b8ba9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:05.780238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dcf6-add8-4432-970c-71156b63b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:05.780896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dcf6-add8-4432-970c-71156b63b11b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.781174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dcf6-add8-4432-970c-71156b63b11b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.781446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dcf6-add8-4432-970c-71156b63b11b None admin] PATH_INFO: `/v3/users/441f32985fbb4b5a9019e5f4c7d7edcf` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.800479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dcf6-add8-4432-970c-71156b63b11b None admin] RBAC: Authorizing `identity:get_user(user_id=441f32985fbb4b5a9019e5f4c7d7edcf)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:05.800479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dcf6-add8-4432-970c-71156b63b11b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:05.802515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 127/244] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:05 2022] GET /identity/v3/users/441f32985fbb4b5a9019e5f4c7d7edcf => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:05.803136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10c8d-7d5b-4c48-b263-6ede314269ac None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.803416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10c8d-7d5b-4c48-b263-6ede314269ac None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.803685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10c8d-7d5b-4c48-b263-6ede314269ac None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.805179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 128/245] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:05.808413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10c8d-7d5b-4c48-b263-6ede314269ac None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:05.864455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 118/246] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:05.866018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249dd8-339e-4e33-9418-af6e254da9e2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:05.866423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249dd8-339e-4e33-9418-af6e254da9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:05.866826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249dd8-339e-4e33-9418-af6e254da9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:05.887943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-38249dd8-339e-4e33-9418-af6e254da9e2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:05.889662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-38249dd8-339e-4e33-9418-af6e254da9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:05.931280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:05.955264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10c8d-7d5b-4c48-b263-6ede314269ac None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:05.983041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 119/247] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:06.002449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:06.003074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.003348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.003611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.050861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:06.080600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:06.082077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:06.179296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249dd8-339e-4e33-9418-af6e254da9e2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.202601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 129/248] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:06.208462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.287096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:06.310089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249dd8-339e-4e33-9418-af6e254da9e2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:06.317725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542acba-86aa-4ff3-8f35-7780122ac31c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:06.351580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:06.352259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.352797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.353276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.356769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:06.357407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.357676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.358169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.359671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:06.361238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:06.366575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:06.367856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 130/249] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:06.368701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:06.373715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:06.374642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:06.375432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:06.377795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 120/250] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:06.379286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.419584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:06.504066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f871e-226b-4326-9749-efd91d0bc953 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:06.506258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ccdbf-7960-4bf9-a54a-df07daa244d1 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:06.544026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:06.544902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.545393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.545787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.547827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:06.548552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.549040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.549408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.550245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] RBAC: Adding query filter params (role.id=88530fd398e84e9fa2d058a50b2ee980, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=441f32985fbb4b5a9019e5f4c7d7edcf) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:06.550647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:06.552248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:06.555323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:06.558735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:06.559912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 121/251] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/role_assignments?user.id=441f32985fbb4b5a9019e5f4c7d7edcf&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=88530fd398e84e9fa2d058a50b2ee980 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:06.568098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:06.573650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:06.574642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:06.575421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:06.578111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 131/252] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:06.583680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.709360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:06.729009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aab83c-bc3b-4319-bfdd-27fdc09b73f7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:06.789634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:06.791332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.791877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.792348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.793247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:06.793803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:06.795501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:06.806339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28082f4-51c3-4264-9676-0b8f932e8e7b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:06.807451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 122/253] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:06.815074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.873192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245688c4-f76c-4ea8-aeac-40c1587d9a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:06.874102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245688c4-f76c-4ea8-aeac-40c1587d9a55 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.874573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245688c4-f76c-4ea8-aeac-40c1587d9a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.874885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245688c4-f76c-4ea8-aeac-40c1587d9a55 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.875575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245688c4-f76c-4ea8-aeac-40c1587d9a55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:06.875900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245688c4-f76c-4ea8-aeac-40c1587d9a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:06.882581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245688c4-f76c-4ea8-aeac-40c1587d9a55 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:06.899943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 132/254] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:06.903008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063956-0c6f-471c-8575-22a9da8eef03 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:06.903281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063956-0c6f-471c-8575-22a9da8eef03 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:06.903544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0063956-0c6f-471c-8575-22a9da8eef03 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:06.909376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 133/255] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:06.911470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063956-0c6f-471c-8575-22a9da8eef03 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:06.997869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980f45-8768-4586-bb57-5c00f6c5d2b3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:07.012589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:07.061463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d743f5-5feb-48b2-89c9-8396c3111724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:07.062115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d743f5-5feb-48b2-89c9-8396c3111724 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:07.062398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d743f5-5feb-48b2-89c9-8396c3111724 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:07.062663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d743f5-5feb-48b2-89c9-8396c3111724 None admin] PATH_INFO: `/v3/users/eef803695d3143ce8d990d0f67fc3173` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:07.064531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d743f5-5feb-48b2-89c9-8396c3111724 None admin] RBAC: Authorizing `identity:get_user(user_id=eef803695d3143ce8d990d0f67fc3173)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:07.066071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d743f5-5feb-48b2-89c9-8396c3111724 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:07.067857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 123/256] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/users/eef803695d3143ce8d990d0f67fc3173 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:07.068814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c880-65cb-4163-a65f-d52c6ff83741 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:07.069109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c880-65cb-4163-a65f-d52c6ff83741 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:07.069363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04c880-65cb-4163-a65f-d52c6ff83741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:07.080983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0063956-0c6f-471c-8575-22a9da8eef03 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:07.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0a04c880-65cb-4163-a65f-d52c6ff83741 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:07.109706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0a04c880-65cb-4163-a65f-d52c6ff83741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:07.144318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:07.144963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:07.145442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:07.145968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:07.146238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] PATH_INFO: `/v3/users/369a91035fe74aafa4b79e52e14bbeb3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:07.148151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] RBAC: Authorizing `identity:get_user(user_id=369a91035fe74aafa4b79e52e14bbeb3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:07.153438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:07.155414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 134/257] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:06 2022] GET /identity/v3/users/369a91035fe74aafa4b79e52e14bbeb3 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:07.156183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:07.237787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 124/258] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:07.238640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c880-65cb-4163-a65f-d52c6ff83741 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:07.358806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c172ae2-4bd1-47f9-80e3-8dd80af38f1a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:07.419106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:07.425538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:07.431351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:07.431638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:07.431935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:07.451151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04c880-65cb-4163-a65f-d52c6ff83741 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:07.514207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:07.514876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:07.515157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:07.515422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:07.517715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:07.519727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:07.526008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 125/259] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:07 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:07.535732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:07.572092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:07.580813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:07.582337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:07.723864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6850f-53f6-4cb5-a488-6527bcd12b91 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:07.758268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 135/260] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:07.759708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:07.787821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:07.789434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:07.790570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:07.791475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/369a91035fe74aafa4b79e52e14bbeb3/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:07.797156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8012cf29932d4c079428afdbfd3d8dff, user_id=369a91035fe74aafa4b79e52e14bbeb3, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:07.799848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:07.816086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:07.825165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 126/261] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:07 2022] PUT /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/369a91035fe74aafa4b79e52e14bbeb3/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:45:07.827736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:07.940625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055e48-7274-425f-9242-e3b004c8ec8b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:08.010424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:08.039482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:08.040156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.040427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.040699 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.057318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcbda2-e9ab-4469-8d74-c0dea94f8ac3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:08.074425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:08.088416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:08.089351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:08.090127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 136/262] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:08.099279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:08.150916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:08.151573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.151877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.152200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.159734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:08.159734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:08.160039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 127/263] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:07 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:08.166316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:08.311647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:08.332326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd212370-d8a5-4d1d-94e9-543de12e2c6c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:08.352423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bcfbe-ca5f-4460-b289-8c854e51afda None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:08.396155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:08.396780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.397053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.397318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.397986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:08.398284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:08.399688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:08.413303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 137/264] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:08.414295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:08.414914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.415189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.415456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.416209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=eef803695d3143ce8d990d0f67fc3173) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:08.416515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:08.418075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:08.420790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:08.432254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 128/265] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:08 2022] GET /identity/v3/role_assignments?user.id=eef803695d3143ce8d990d0f67fc3173&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:08.591921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adeaa9-192d-4e19-a730-b3bf21c36d8b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:08.638227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77e5e-ad6d-4ddc-a67d-1dcdd59a997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:08.638987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77e5e-ad6d-4ddc-a67d-1dcdd59a997d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.639260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77e5e-ad6d-4ddc-a67d-1dcdd59a997d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.639530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77e5e-ad6d-4ddc-a67d-1dcdd59a997d None admin] PATH_INFO: `/v3/users/eef803695d3143ce8d990d0f67fc3173` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.644377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d77e5e-ad6d-4ddc-a67d-1dcdd59a997d None admin] RBAC: Authorizing `identity:get_user(user_id=eef803695d3143ce8d990d0f67fc3173)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:08.645872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d77e5e-ad6d-4ddc-a67d-1dcdd59a997d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:08.647860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 138/266] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:08 2022] GET /identity/v3/users/eef803695d3143ce8d990d0f67fc3173 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:08.653360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:08.681224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:08.808607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444343a-3eac-496d-a81c-cec45718a9ff None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:08.817290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaacc93-b48f-46ce-85bd-a2b859374c50 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.817931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaacc93-b48f-46ce-85bd-a2b859374c50 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.817931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaacc93-b48f-46ce-85bd-a2b859374c50 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.819485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 139/267] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:08.825008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4448f-02d1-48fd-b6a0-d6ed5eff2ab9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.825290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4448f-02d1-48fd-b6a0-d6ed5eff2ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.825562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4448f-02d1-48fd-b6a0-d6ed5eff2ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.855691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0100c-ab91-4602-8dc1-1db6f4e65fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:08.856626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0100c-ab91-4602-8dc1-1db6f4e65fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:08.857065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0100c-ab91-4602-8dc1-1db6f4e65fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:08.857488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0100c-ab91-4602-8dc1-1db6f4e65fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:08.860713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1bb4448f-02d1-48fd-b6a0-d6ed5eff2ab9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:08.864184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1bb4448f-02d1-48fd-b6a0-d6ed5eff2ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:08.890676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:08.983771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0100c-ab91-4602-8dc1-1db6f4e65fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:08.985261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0100c-ab91-4602-8dc1-1db6f4e65fc6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:09.001780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 140/268] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:09.013689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:09.119114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 129/269] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:09.125373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4448f-02d1-48fd-b6a0-d6ed5eff2ab9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:09.255918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d713-2c5b-46ee-8621-6716b168a776 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.256244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d713-2c5b-46ee-8621-6716b168a776 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.256455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7d713-2c5b-46ee-8621-6716b168a776 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.258046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 130/270] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:09.262767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6398e30-b20f-424d-a3c6-14bc6a6cb268 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.263044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6398e30-b20f-424d-a3c6-14bc6a6cb268 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.263307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6398e30-b20f-424d-a3c6-14bc6a6cb268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.270152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4448f-02d1-48fd-b6a0-d6ed5eff2ab9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:09.307727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e6398e30-b20f-424d-a3c6-14bc6a6cb268 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:09.307727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e6398e30-b20f-424d-a3c6-14bc6a6cb268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:09.328722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5567fee-64ad-43ed-ba0a-e639c02a7955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:09.329778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567fee-64ad-43ed-ba0a-e639c02a7955 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.330323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567fee-64ad-43ed-ba0a-e639c02a7955 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.330779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5567fee-64ad-43ed-ba0a-e639c02a7955 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.332150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567fee-64ad-43ed-ba0a-e639c02a7955 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:09.333966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5567fee-64ad-43ed-ba0a-e639c02a7955 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:09.336360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 141/271] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:09 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:09.337756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a4e8-e188-4ec0-a0e7-72a4f3ca9d85 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.338226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a4e8-e188-4ec0-a0e7-72a4f3ca9d85 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.338762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999a4e8-e188-4ec0-a0e7-72a4f3ca9d85 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.340788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 142/272] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:09.341732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999a4e8-e188-4ec0-a0e7-72a4f3ca9d85 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:09.363898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:09.390350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 131/273] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:09.391361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f32d-87bf-46a3-ab46-5d7f6df1ce02 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.392154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f32d-87bf-46a3-ab46-5d7f6df1ce02 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.392426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f32d-87bf-46a3-ab46-5d7f6df1ce02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.413868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c6a4f32d-87bf-46a3-ab46-5d7f6df1ce02 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:09.415260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c6a4f32d-87bf-46a3-ab46-5d7f6df1ce02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:09.464590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:09.479017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999a4e8-e188-4ec0-a0e7-72a4f3ca9d85 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:09.499831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 132/274] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:09.500675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f32d-87bf-46a3-ab46-5d7f6df1ce02 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:09.550220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:09.551386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.551944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.552403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.553438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] RBAC: Adding query filter params (role.id=8bb219ecae85425b811774a579941e97, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=eef803695d3143ce8d990d0f67fc3173) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:09.553937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:09.555711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:09.573511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 143/275] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:09 2022] GET /identity/v3/role_assignments?user.id=eef803695d3143ce8d990d0f67fc3173&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=8bb219ecae85425b811774a579941e97 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:09.710859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f32d-87bf-46a3-ab46-5d7f6df1ce02 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:09.720393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:09.781192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:09.782718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.782991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.783250 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.799528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:09.804883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:09.805796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 133/276] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:09.807065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:09.845868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:09.856216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:09.871307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694dc1f-b353-4ff9-b6f2-3e8728f8ca02 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:09.914328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:09.914971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.915246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.915523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.916664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:09.918223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:09.919845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 144/277] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:09.920805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:09.929149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e894101-2d65-49d0-b039-2e1196ea1485 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:09.967000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:09.967777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:09.968091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:09.968355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:09.978480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:09.983393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:09.984411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 134/278] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:09.985220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:10.030098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ba12-554a-4e4c-82b3-fc8c5fd3a3a7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.064862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.065521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.065795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.066069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.066729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:10.067028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.068449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.082007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 145/279] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:10.082007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:10.083248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:10.088901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a09425-d13d-48f2-ad0c-5a0b34f48d0e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.097980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:10.127517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.128266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.128536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.128834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.129434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.130876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.155207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 135/280] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:09 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:10.156088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:10.195317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b35da-89be-41b5-9187-d63ffdec831f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.234778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.235799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.236285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.236760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.237965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:10.238461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.240131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.251748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 146/281] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:10.257546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:10.288069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb342404-d541-4592-901b-c6ba12975b23 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.332102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.332769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.333052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.333573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] PATH_INFO: `/v3/users/f64e2fc908004067ab9538423e01b9d5` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.353062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] RBAC: Authorizing `identity:get_user(user_id=f64e2fc908004067ab9538423e01b9d5)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.354543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.355227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:10.357008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 136/282] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:10 2022] GET /identity/v3/users/f64e2fc908004067ab9538423e01b9d5 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:10.363064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:10.373414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:10.392547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe4a6-8600-43dc-a80d-f5ecf95ca23b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.433434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.434078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.434359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.434613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] PATH_INFO: `/v3/users/441f32985fbb4b5a9019e5f4c7d7edcf` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.437866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=441f32985fbb4b5a9019e5f4c7d7edcf)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.437866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.439585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 147/283] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:10 2022] GET /identity/v3/users/441f32985fbb4b5a9019e5f4c7d7edcf => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:10.447627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:10.481783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0bd09-c1ac-43a2-aa51-3e6ceea0fa0b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.530284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.530836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.531110 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.531371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.532131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, user.id=f64e2fc908004067ab9538423e01b9d5, scope.system=all) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:10.532432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.533881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.539859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 137/284] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Sep 15 12:45:10 2022] GET /identity/v3/role_assignments?user.id=f64e2fc908004067ab9538423e01b9d5&scope.system=all&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:10.571411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee70f-098d-47f8-8235-16857528c4c8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.611029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502c1d8-761b-4353-a7d4-64921cfa85f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.612472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c1d8-761b-4353-a7d4-64921cfa85f3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.612949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c1d8-761b-4353-a7d4-64921cfa85f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.613432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502c1d8-761b-4353-a7d4-64921cfa85f3 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.615013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c1d8-761b-4353-a7d4-64921cfa85f3 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.616799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502c1d8-761b-4353-a7d4-64921cfa85f3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.618755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 148/285] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:10 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:10.627274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:10.713729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:10.754230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f0d6f-1196-413d-8f05-a13d0006e958 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:10.791092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92177ce4-f8b6-4abd-8220-dbd2e9a8dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:10.791714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92177ce4-f8b6-4abd-8220-dbd2e9a8dba1 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.792006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92177ce4-f8b6-4abd-8220-dbd2e9a8dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.792275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92177ce4-f8b6-4abd-8220-dbd2e9a8dba1 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/441f32985fbb4b5a9019e5f4c7d7edcf/roles/88530fd398e84e9fa2d058a50b2ee980` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.794406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92177ce4-f8b6-4abd-8220-dbd2e9a8dba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8012cf29932d4c079428afdbfd3d8dff, user_id=441f32985fbb4b5a9019e5f4c7d7edcf, role_id=88530fd398e84e9fa2d058a50b2ee980)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:10.795992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92177ce4-f8b6-4abd-8220-dbd2e9a8dba1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:10.815934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 138/286] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:10 2022] PUT /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff/users/441f32985fbb4b5a9019e5f4c7d7edcf/roles/88530fd398e84e9fa2d058a50b2ee980 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:45:10.835761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fd44c-f427-417e-84f5-90efee8d9e1b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.836082 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fd44c-f427-417e-84f5-90efee8d9e1b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.836299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fd44c-f427-417e-84f5-90efee8d9e1b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.837986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 149/287] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:10.844725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2227cc-0cdc-487c-af57-29fba02c635b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:10.845042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2227cc-0cdc-487c-af57-29fba02c635b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:10.845325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2227cc-0cdc-487c-af57-29fba02c635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:10.866524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5d2227cc-0cdc-487c-af57-29fba02c635b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:10.867865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5d2227cc-0cdc-487c-af57-29fba02c635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:10.974572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 139/288] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:11.270961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fd44c-f427-417e-84f5-90efee8d9e1b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:11.288847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:11.404101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fd44c-f427-417e-84f5-90efee8d9e1b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:11.465442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:11.466085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:11.466355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:11.466619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:11.484603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:11.490293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:11.491143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:11.492030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 150/289] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:11.497502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2227cc-0cdc-487c-af57-29fba02c635b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:11.590341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:11.651317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2227cc-0cdc-487c-af57-29fba02c635b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:11.702451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:11.703093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:11.703365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:11.703627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:11.704342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:11.704637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:11.706051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:11.721444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 140/290] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:11.727203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:11.830469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:11.874569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ed552-55ab-4ca2-98a4-9aed1e09289a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:11.911736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:11.912479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:11.912751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:11.913014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] PATH_INFO: `/v3/users/369a91035fe74aafa4b79e52e14bbeb3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:11.914130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] RBAC: Authorizing `identity:get_user(user_id=369a91035fe74aafa4b79e52e14bbeb3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:11.915583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:11.917478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 151/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:11 2022] GET /identity/v3/users/369a91035fe74aafa4b79e52e14bbeb3 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:11.923057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:12.075020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d0fda-7c9c-44e0-ba86-1eec725244ff None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:12.104869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:12.125006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:12.125565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:12.125839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:12.126105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:12.210372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:12.211866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:12.321017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 141/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:12.326905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:12.426239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87adfc-b300-48b3-adb6-ca23e1391839 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:12.460546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5c71d-4a1b-4448-b7ff-94c425882180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:12.461179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5c71d-4a1b-4448-b7ff-94c425882180 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:12.461450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5c71d-4a1b-4448-b7ff-94c425882180 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:12.461711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5c71d-4a1b-4448-b7ff-94c425882180 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:12.462820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5c71d-4a1b-4448-b7ff-94c425882180 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:12.464304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5c71d-4a1b-4448-b7ff-94c425882180 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:12.465926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 152/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:12 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:12.472004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:12.510371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:12.586160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55c036-66cf-4ac3-8063-f322bd491809 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:12.625403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c479f-6817-495d-8c56-5560b38c92db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:12.626026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c479f-6817-495d-8c56-5560b38c92db None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:12.626297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c479f-6817-495d-8c56-5560b38c92db None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:12.626561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c479f-6817-495d-8c56-5560b38c92db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:12.627290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c479f-6817-495d-8c56-5560b38c92db None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=369a91035fe74aafa4b79e52e14bbeb3) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:12.627584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c479f-6817-495d-8c56-5560b38c92db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:12.629036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c479f-6817-495d-8c56-5560b38c92db None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:12.641081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 142/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:12 2022] GET /identity/v3/role_assignments?user.id=369a91035fe74aafa4b79e52e14bbeb3&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:13.097755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1e47-4d13-4557-bca4-7d70f5d08d3d None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.098034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1e47-4d13-4557-bca4-7d70f5d08d3d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.098550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1e47-4d13-4557-bca4-7d70f5d08d3d None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.100438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 153/295] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:13.106053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c1525-e350-4c62-bfe7-e74e7a85094b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.106905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c1525-e350-4c62-bfe7-e74e7a85094b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.107426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c1525-e350-4c62-bfe7-e74e7a85094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.126915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3a2c1525-e350-4c62-bfe7-e74e7a85094b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:13.128467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3a2c1525-e350-4c62-bfe7-e74e7a85094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:13.184928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57939327-3b96-49f5-a9c8-fdc72ed7ea64 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.185596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57939327-3b96-49f5-a9c8-fdc72ed7ea64 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.186222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57939327-3b96-49f5-a9c8-fdc72ed7ea64 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.188293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 154/296] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:13.197746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2256bc-6356-447a-a1d1-e99ff9796292 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.198457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2256bc-6356-447a-a1d1-e99ff9796292 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.198977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2256bc-6356-447a-a1d1-e99ff9796292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.216485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 143/297] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:13.220049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:13.228717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4d2256bc-6356-447a-a1d1-e99ff9796292 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:13.229905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4d2256bc-6356-447a-a1d1-e99ff9796292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:13.296126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db665-362a-4a14-b2f7-a6237c034849 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.296126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db665-362a-4a14-b2f7-a6237c034849 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.296126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25db665-362a-4a14-b2f7-a6237c034849 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.297245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 144/298] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:13.302551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d19d1-a428-43e9-9df9-de838589afa7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.302787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 155/299] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:13.303265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d19d1-a428-43e9-9df9-de838589afa7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.303598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d19d1-a428-43e9-9df9-de838589afa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.326317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a18d19d1-a428-43e9-9df9-de838589afa7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:13.328179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a18d19d1-a428-43e9-9df9-de838589afa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:13.339626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:13.400213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 145/300] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:13.513662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2256bc-6356-447a-a1d1-e99ff9796292 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:13.574798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d19d1-a428-43e9-9df9-de838589afa7 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:13.622016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2256bc-6356-447a-a1d1-e99ff9796292 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:13.673128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:13.674291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.674707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.675101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.677551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:13.679841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:13.682948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 156/301] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:13.688103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:13.693601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d19d1-a428-43e9-9df9-de838589afa7 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:13.693827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:13.728455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:13.734391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.735047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.735315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.745902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:13.751015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:13.751951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 146/302] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:13.752963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:13.762238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:13.793370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1fc2-d0d4-462f-addf-f453f8d243f9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:13.826766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b10ff-6858-46c3-9678-84166cb75e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:13.827396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b10ff-6858-46c3-9678-84166cb75e50 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.827672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b10ff-6858-46c3-9678-84166cb75e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.827968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b10ff-6858-46c3-9678-84166cb75e50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.837768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b10ff-6858-46c3-9678-84166cb75e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9a2b10ff-6858-46c3-9678-84166cb75e50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:13.842635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:13.843522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:13.844330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 157/303] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:13.845045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c9a96-d76c-4509-8831-06906bc278b3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.845248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c9a96-d76c-4509-8831-06906bc278b3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.845471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c9a96-d76c-4509-8831-06906bc278b3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.846761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 158/304] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:13.847457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c9a96-d76c-4509-8831-06906bc278b3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:13.855728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec377-515f-46b6-bcfa-96139df93b59 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:13.888817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:13.889428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:13.889699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:13.889957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] PATH_INFO: `/v3/groups` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:13.890565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:13.892033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:13.907508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 147/305] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Sep 15 12:45:13 2022] POST /identity/v3/groups => generated 229 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:13.908343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:13.918869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:13.966185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c9a96-d76c-4509-8831-06906bc278b3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:13.987298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:14.008352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc74b-d87c-488e-b30e-f70b959de8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.009255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc74b-d87c-488e-b30e-f70b959de8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.009666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc74b-d87c-488e-b30e-f70b959de8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.010062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc74b-d87c-488e-b30e-f70b959de8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.011074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdc74b-d87c-488e-b30e-f70b959de8a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:14.011521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdc74b-d87c-488e-b30e-f70b959de8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.013825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdc74b-d87c-488e-b30e-f70b959de8a3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.026676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 159/306] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:14.029113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9185-e471-4b84-959c-6ec4c5af61ed None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.030457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9185-e471-4b84-959c-6ec4c5af61ed None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.031079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9185-e471-4b84-959c-6ec4c5af61ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.033145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69342395-8602-4ea1-bbd2-fc8846f7f0af None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.057193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-01fd9185-e471-4b84-959c-6ec4c5af61ed None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:14.058756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-01fd9185-e471-4b84-959c-6ec4c5af61ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:14.071692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.072350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.072641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.072897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.073572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:14.073871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.075270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.089559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 148/307] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:14.090349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:14.140463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 160/308] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:14.141317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9185-e471-4b84-959c-6ec4c5af61ed None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:14.202874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:14.211548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0e02-280c-4557-924a-0c8d7eee89a8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.248502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:14.249105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9185-e471-4b84-959c-6ec4c5af61ed None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.252318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.252979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.253508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.253771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] PATH_INFO: `/v3/users/00c291ce1b114aab8e93bf4edcc937a3` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.270305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=00c291ce1b114aab8e93bf4edcc937a3)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.271865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.274405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 149/309] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:14 2022] GET /identity/v3/users/00c291ce1b114aab8e93bf4edcc937a3 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:14.280401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:14.289520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.290164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.290438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.290702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] PATH_INFO: `/v3/users/f64e2fc908004067ab9538423e01b9d5` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.291939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=f64e2fc908004067ab9538423e01b9d5)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.293393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.300068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 161/310] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:14 2022] GET /identity/v3/users/f64e2fc908004067ab9538423e01b9d5 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:14.301142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:14.395552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3a3c9-a0d7-4fd5-9ea5-b8f69e43b2e6 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.412593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17218cd1-1115-421c-a807-299a6d355ee7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.438667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.439290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.439941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.439941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.443718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:14.443842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] RBAC: Adding query filter params (role.id=88530fd398e84e9fa2d058a50b2ee980, user.id=00c291ce1b114aab8e93bf4edcc937a3, scope.system=all) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:14.443842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.443842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.448133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 150/311] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Sep 15 12:45:14 2022] GET /identity/v3/role_assignments?user.id=00c291ce1b114aab8e93bf4edcc937a3&scope.system=all&role.id=88530fd398e84e9fa2d058a50b2ee980 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:14.449060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:14.452857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.453530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.453806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.454076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] PATH_INFO: `/v3/system/users/f64e2fc908004067ab9538423e01b9d5/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.455519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f64e2fc908004067ab9538423e01b9d5, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.456955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.480195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 162/312] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Sep 15 12:45:14 2022] PUT /identity/v3/system/users/f64e2fc908004067ab9538423e01b9d5/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:45:14.521358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:14.585913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa50cb-2745-4d1e-9585-634daf1eb1cd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.628680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.629369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.629647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.629914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.644332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:14.649391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:14.651463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:14.653358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 151/313] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:14.658063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:14.770545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa57a77-190f-4d47-8f54-d3017b061be5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.806201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.806786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.807065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.807328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.808016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:14.808360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.809823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.819499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 163/314] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:14.825375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:14.934979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e9c7c-44b1-4337-9c22-f50d8a4fa748 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:14.946189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:14.971317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:14.971982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:14.972256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:14.972561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] PATH_INFO: `/v3/users/441f32985fbb4b5a9019e5f4c7d7edcf` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:14.973676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] RBAC: Authorizing `identity:get_user(user_id=441f32985fbb4b5a9019e5f4c7d7edcf)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:14.975134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:14.977047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 152/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:14 2022] GET /identity/v3/users/441f32985fbb4b5a9019e5f4c7d7edcf => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:14.982380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:15.036395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:15.088837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f276f6-f748-4fdd-a92a-44c207b90a46 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:15.127998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:15.128622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:15.128897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:15.129163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:15.199586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:15.201470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:15.253852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:15.308697 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 164/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:15.314260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:15.420565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c44b-6462-41a5-b09e-b251f8c12617 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:15.458859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765970-28bb-4770-aa03-b15fed13e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:15.459508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765970-28bb-4770-aa03-b15fed13e7ef None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:15.460035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765970-28bb-4770-aa03-b15fed13e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:15.460300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765970-28bb-4770-aa03-b15fed13e7ef None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:15.461422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765970-28bb-4770-aa03-b15fed13e7ef None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:15.462850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765970-28bb-4770-aa03-b15fed13e7ef None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:15.464820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 153/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:15 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:15.470805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:15.574169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd5383-72b7-40de-a885-f1b55fdc321f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:15.609962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5deca3-0fd7-4bbc-9749-92573216ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:15.611003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5deca3-0fd7-4bbc-9749-92573216ee20 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:15.611493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5deca3-0fd7-4bbc-9749-92573216ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:15.612423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5deca3-0fd7-4bbc-9749-92573216ee20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:15.613343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5deca3-0fd7-4bbc-9749-92573216ee20 None admin] RBAC: Adding query filter params (role.id=88530fd398e84e9fa2d058a50b2ee980, scope.project.id=8012cf29932d4c079428afdbfd3d8dff, user.id=441f32985fbb4b5a9019e5f4c7d7edcf) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:15.613837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5deca3-0fd7-4bbc-9749-92573216ee20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:15.615625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5deca3-0fd7-4bbc-9749-92573216ee20 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:15.622048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 165/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:15 2022] GET /identity/v3/role_assignments?user.id=441f32985fbb4b5a9019e5f4c7d7edcf&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=88530fd398e84e9fa2d058a50b2ee980 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:16.188295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8f54-182c-4dfd-98c7-2ab953de738f None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.188706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8f54-182c-4dfd-98c7-2ab953de738f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.188802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8f54-182c-4dfd-98c7-2ab953de738f None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.190346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 154/319] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:16.195619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502cf53-5e23-4fad-92a1-664b08bedeef None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.196107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502cf53-5e23-4fad-92a1-664b08bedeef None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.196179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502cf53-5e23-4fad-92a1-664b08bedeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.215098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5502cf53-5e23-4fad-92a1-664b08bedeef None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:16.216295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5502cf53-5e23-4fad-92a1-664b08bedeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:16.226703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:16.287961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 166/320] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:16.549672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f8f54-182c-4dfd-98c7-2ab953de738f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:16.602071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:16.639354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89937-fd61-4c6c-a25a-a0d339b36773 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.639739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89937-fd61-4c6c-a25a-a0d339b36773 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.639959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89937-fd61-4c6c-a25a-a0d339b36773 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.641448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 167/321] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:16.646117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965021b9-9a12-4aec-b758-a3726552252b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.646392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965021b9-9a12-4aec-b758-a3726552252b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.646652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965021b9-9a12-4aec-b758-a3726552252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.662044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f8f54-182c-4dfd-98c7-2ab953de738f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:16.666599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-965021b9-9a12-4aec-b758-a3726552252b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:16.667869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-965021b9-9a12-4aec-b758-a3726552252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:16.703343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:16.703921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.704192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.704452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.705510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:16.706980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:16.708742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 155/322] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:16.714199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:16.745846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 168/323] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:16.784192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e89e-a28d-4043-8cd7-fd82a2c6eb71 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.784530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e89e-a28d-4043-8cd7-fd82a2c6eb71 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.784818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e89e-a28d-4043-8cd7-fd82a2c6eb71 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.786408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 169/324] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:16.791030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da477577-ebb4-4523-8b31-10ca0daa66b8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.791309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da477577-ebb4-4523-8b31-10ca0daa66b8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.791574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da477577-ebb4-4523-8b31-10ca0daa66b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.811864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-da477577-ebb4-4523-8b31-10ca0daa66b8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:16.813038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-da477577-ebb4-4523-8b31-10ca0daa66b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:16.825360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5d2a3-2d76-4576-8b85-9d5c8e66d353 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:16.840275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:16.862435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:16.863056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:16.863333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:16.863605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] PATH_INFO: `/v3/groups` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:16.864269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:16.865731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:16.884121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 170/325] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:16.892384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 156/326] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Sep 15 12:45:16 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:45:17.010627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da477577-ebb4-4523-8b31-10ca0daa66b8 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.014965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:17.125928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da477577-ebb4-4523-8b31-10ca0daa66b8 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.151842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.164400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.165043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.165380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.165654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.178391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:17.184417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:17.185321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:17.186160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 171/327] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:17.193220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.267532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:17.293611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f0842-5095-45d1-b8f4-9cd1a99ec4b1 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.314604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5efdb3-b8bd-44cc-b923-c518a74e9f49 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.338993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.339809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.340073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.340342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.355928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:17.359375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.360024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.360299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.360566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.361243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] RBAC: Adding query filter params (name=reader) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:17.361540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:17.363289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:17.364460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:17.365344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:17.366117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:17.368809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 157/328] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:17.372534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 172/329] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:17.377810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.377960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.416528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:17.497620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb3d99-3c3c-4bc6-a821-9a573aa42c5e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.506729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4371e60-c3f7-4477-bbe2-3c02dec0a7be None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.537051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:17.542819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.543766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.544261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.544785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.545747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:17.546237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:17.548122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.548566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.548841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.549107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] PATH_INFO: `/v3/users/00c291ce1b114aab8e93bf4edcc937a3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.550168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:17.550593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] RBAC: Authorizing `identity:get_user(user_id=00c291ce1b114aab8e93bf4edcc937a3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:17.551655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:17.558147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 173/330] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:17 2022] GET /identity/v3/users/00c291ce1b114aab8e93bf4edcc937a3 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:17.558873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.565207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 158/331] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:17.570701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.687093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6aa37-20bf-40fd-bbcc-a16445e558b4 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.696555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:17.705820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691be7f1-6721-4220-8481-8bb6d39b3807 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.735399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05187fdb-f1b7-42d8-b58c-a03a1a5677b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.736540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187fdb-f1b7-42d8-b58c-a03a1a5677b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.737372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187fdb-f1b7-42d8-b58c-a03a1a5677b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.737852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05187fdb-f1b7-42d8-b58c-a03a1a5677b2 None admin] PATH_INFO: `/v3/system/users/00c291ce1b114aab8e93bf4edcc937a3/roles/88530fd398e84e9fa2d058a50b2ee980` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.741451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05187fdb-f1b7-42d8-b58c-a03a1a5677b2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=00c291ce1b114aab8e93bf4edcc937a3, role_id=88530fd398e84e9fa2d058a50b2ee980)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:17.743088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05187fdb-f1b7-42d8-b58c-a03a1a5677b2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:17.744444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.745606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.745713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.746041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] PATH_INFO: `/v3/users/f64e2fc908004067ab9538423e01b9d5` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.748412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] RBAC: Authorizing `identity:get_user(user_id=f64e2fc908004067ab9538423e01b9d5)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:17.750353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:17.754605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 159/332] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:17 2022] GET /identity/v3/users/f64e2fc908004067ab9538423e01b9d5 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:17.759316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:17.760554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 174/333] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Sep 15 12:45:17 2022] PUT /identity/v3/system/users/00c291ce1b114aab8e93bf4edcc937a3/roles/88530fd398e84e9fa2d058a50b2ee980 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:17.879343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a8a4-a95b-4865-a8c6-c16cb6e7a67f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:17.917916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860e694-5674-4bcb-8e17-26a5fd1ec722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:17.918877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e694-5674-4bcb-8e17-26a5fd1ec722 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:17.919290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e694-5674-4bcb-8e17-26a5fd1ec722 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:17.919929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e694-5674-4bcb-8e17-26a5fd1ec722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:17.920976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e694-5674-4bcb-8e17-26a5fd1ec722 None admin] RBAC: Adding query filter params (role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, user.id=f64e2fc908004067ab9538423e01b9d5, scope.system=all) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:17.921448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e694-5674-4bcb-8e17-26a5fd1ec722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:17.923123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e694-5674-4bcb-8e17-26a5fd1ec722 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:17.939097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 160/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Sep 15 12:45:17 2022] GET /identity/v3/role_assignments?user.id=f64e2fc908004067ab9538423e01b9d5&scope.system=all&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:19.520679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddebdc-d508-44a4-9b55-c3b5079cf03c None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:19.521232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddebdc-d508-44a4-9b55-c3b5079cf03c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:19.521232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddebdc-d508-44a4-9b55-c3b5079cf03c None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:19.522852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 175/335] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:19.528457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8cb6-3483-48c6-9885-1999215c2b3a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:19.529531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8cb6-3483-48c6-9885-1999215c2b3a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:19.529997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a8cb6-3483-48c6-9885-1999215c2b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:19.556949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-6b5a8cb6-3483-48c6-9885-1999215c2b3a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:19.558463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6b5a8cb6-3483-48c6-9885-1999215c2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:19.578618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:19.633449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 161/336] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:19.817588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5577977-8880-4d5e-bb13-2aa34c085693 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:19.817779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5577977-8880-4d5e-bb13-2aa34c085693 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:19.818046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5577977-8880-4d5e-bb13-2aa34c085693 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:19.819454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 176/337] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:19.840679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fbf34-97d1-41d0-9bff-bf23c8502a8b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:19.840679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fbf34-97d1-41d0-9bff-bf23c8502a8b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:19.840679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fbf34-97d1-41d0-9bff-bf23c8502a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:19.868748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-135fbf34-97d1-41d0-9bff-bf23c8502a8b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:19.870276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-135fbf34-97d1-41d0-9bff-bf23c8502a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:19.950326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 162/338] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:20.115834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5577977-8880-4d5e-bb13-2aa34c085693 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:20.185463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:20.246997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5577977-8880-4d5e-bb13-2aa34c085693 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:20.288445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:20.289088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:20.289358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:20.289619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:20.304083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:20.309770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:20.311464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:20.312811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 177/339] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:20.317911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fbf34-97d1-41d0-9bff-bf23c8502a8b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:20.448098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:20.459772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fbf34-97d1-41d0-9bff-bf23c8502a8b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:20.500426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:20.501054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:20.501334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:20.501601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:20.502272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:20.502572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:20.504073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:20.510510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:20.513636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 163/340] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:20.522354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:20.694147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa427-6b25-4108-b77e-e6e9e9398005 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:20.714557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:20.741523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f459-9df3-4d68-89ed-7f2768a41c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:20.742173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f459-9df3-4d68-89ed-7f2768a41c3b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:20.742449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f459-9df3-4d68-89ed-7f2768a41c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:20.742717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f459-9df3-4d68-89ed-7f2768a41c3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:20.756741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec560-6d5f-4301-bea0-7a2d94ebc31f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:20.770890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8f459-9df3-4d68-89ed-7f2768a41c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-1cb8f459-9df3-4d68-89ed-7f2768a41c3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:20.776364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:20.777221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:20.778028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:20.782368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 178/341] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:20.783658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88f1c-ae4d-4071-9b72-482b58143ee5 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:20.783959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88f1c-ae4d-4071-9b72-482b58143ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:20.784227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88f1c-ae4d-4071-9b72-482b58143ee5 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:20.787970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 179/342] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:20.788917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee88f1c-ae4d-4071-9b72-482b58143ee5 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:20.820859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848c446-0f86-481d-b98c-8401df0d7b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:20.821490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c446-0f86-481d-b98c-8401df0d7b13 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:20.821770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c446-0f86-481d-b98c-8401df0d7b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:20.822036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848c446-0f86-481d-b98c-8401df0d7b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:20.846781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:20.953230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848c446-0f86-481d-b98c-8401df0d7b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:20.954654 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848c446-0f86-481d-b98c-8401df0d7b13 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:20.995133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee88f1c-ae4d-4071-9b72-482b58143ee5 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:21.064859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cc5d4-ac65-4980-b4a1-eaf7aaed6cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:21.065500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc5d4-ac65-4980-b4a1-eaf7aaed6cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.065775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc5d4-ac65-4980-b4a1-eaf7aaed6cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.066041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc5d4-ac65-4980-b4a1-eaf7aaed6cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.066711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc5d4-ac65-4980-b4a1-eaf7aaed6cb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:21.067008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc5d4-ac65-4980-b4a1-eaf7aaed6cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:21.068454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc5d4-ac65-4980-b4a1-eaf7aaed6cb4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:21.086951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 180/343] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:21.089814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79529-89b8-4c84-aac9-8e84a956aaf0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.089814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79529-89b8-4c84-aac9-8e84a956aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.089814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c79529-89b8-4c84-aac9-8e84a956aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.090401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 164/344] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:21.092043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951ba6a-bdba-4c84-9953-faa58f42042d None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.092538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951ba6a-bdba-4c84-9953-faa58f42042d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.093017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951ba6a-bdba-4c84-9953-faa58f42042d None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.094765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 165/345] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:21.099229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951ba6a-bdba-4c84-9953-faa58f42042d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:21.116384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-d8c79529-89b8-4c84-aac9-8e84a956aaf0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:21.117952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d8c79529-89b8-4c84-aac9-8e84a956aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:21.164067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:21.164529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:21.206567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 181/346] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:21.212608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c79529-89b8-4c84-aac9-8e84a956aaf0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:21.239687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951ba6a-bdba-4c84-9953-faa58f42042d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:21.310639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:21.312563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.312836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.313105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.407266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c79529-89b8-4c84-aac9-8e84a956aaf0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:21.453120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:21.454617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:21.461171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535289-f16f-460f-a8b6-d6b733d1d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:21.461751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535289-f16f-460f-a8b6-d6b733d1d42f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.462028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535289-f16f-460f-a8b6-d6b733d1d42f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.462340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535289-f16f-460f-a8b6-d6b733d1d42f None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.463482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535289-f16f-460f-a8b6-d6b733d1d42f None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:21.465056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535289-f16f-460f-a8b6-d6b733d1d42f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:21.466857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 182/347] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:21 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:21.471837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0b120-bb35-467c-8cc7-bae822a0a374 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.472139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0b120-bb35-467c-8cc7-bae822a0a374 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.472387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0b120-bb35-467c-8cc7-bae822a0a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.495829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a0d0b120-bb35-467c-8cc7-bae822a0a374 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:21.497486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a0d0b120-bb35-467c-8cc7-bae822a0a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:21.545106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:21.566878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:21.591594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 183/348] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:21.595785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0b120-bb35-467c-8cc7-bae822a0a374 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:21.650677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 166/349] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:21.651690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:21.721904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0b120-bb35-467c-8cc7-bae822a0a374 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:21.760467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71003fb6-d233-44bf-899f-3889ae76cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:21.761206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003fb6-d233-44bf-899f-3889ae76cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.761490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003fb6-d233-44bf-899f-3889ae76cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.761761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003fb6-d233-44bf-899f-3889ae76cdc6 None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.768388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71003fb6-d233-44bf-899f-3889ae76cdc6 None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:21.770056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71003fb6-d233-44bf-899f-3889ae76cdc6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:21.772385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 184/350] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:21 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:21.773605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ffb7-c407-437f-beb9-0f41b6948201 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.773886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ffb7-c407-437f-beb9-0f41b6948201 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.774151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8ffb7-c407-437f-beb9-0f41b6948201 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.775520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 185/351] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:21.779974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8ffb7-c407-437f-beb9-0f41b6948201 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:21.780797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10fb87-48f3-440b-afdf-8e530f1c2861 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:21.814864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:21.825665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbe48d-6b48-4282-8c12-56236c7bae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:21.826317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe48d-6b48-4282-8c12-56236c7bae4e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.827125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe48d-6b48-4282-8c12-56236c7bae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.827404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbe48d-6b48-4282-8c12-56236c7bae4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.839535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbe48d-6b48-4282-8c12-56236c7bae4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-c1fbe48d-6b48-4282-8c12-56236c7bae4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:21.845467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:21.846359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:21.847171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 167/352] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:21.848461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb750-e336-4bde-9d76-7fd7a63818c6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.851750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb750-e336-4bde-9d76-7fd7a63818c6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.851750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eb750-e336-4bde-9d76-7fd7a63818c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.857646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:21.869373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0c1eb750-e336-4bde-9d76-7fd7a63818c6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:21.870577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0c1eb750-e336-4bde-9d76-7fd7a63818c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:21.899033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8ffb7-c407-437f-beb9-0f41b6948201 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:21.937721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:21.938372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:21.938646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:21.938914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:21.940083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:21.941545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:21.948078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 186/353] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:21 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:21.948350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 168/354] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:21.949182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:21.949346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eb750-e336-4bde-9d76-7fd7a63818c6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.075278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:22.078773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a363b48-321d-458b-ac9b-f9b5edea563d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:22.087415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eb750-e336-4bde-9d76-7fd7a63818c6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:22.128674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:22.129288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.129546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.129821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.130760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:22.130867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:22.132305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:22.135456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:22.136110 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.136389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.136652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.137311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:22.137608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:22.138771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 187/355] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:21 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:22.139047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:22.139571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.149354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 169/356] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:22.156438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.160152 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:22.287745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1986256-40b5-4bfe-9ffc-2b4a2b3ad419 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:22.301392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade218f2-e43c-410c-99e8-653459e3455d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:22.344320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:22.345519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.345971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.346407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.350126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62621a02-bd53-4051-aaf4-e2eafc55410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:22.350775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62621a02-bd53-4051-aaf4-e2eafc55410e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.351046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62621a02-bd53-4051-aaf4-e2eafc55410e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.351309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62621a02-bd53-4051-aaf4-e2eafc55410e None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.353668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62621a02-bd53-4051-aaf4-e2eafc55410e None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:22.355105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62621a02-bd53-4051-aaf4-e2eafc55410e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:22.357303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 170/357] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:22 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:22.358938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2794-f9ec-4a75-b055-0ef1d0d74499 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.359212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2794-f9ec-4a75-b055-0ef1d0d74499 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.359475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2794-f9ec-4a75-b055-0ef1d0d74499 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.360864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 171/358] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:22.361149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:22.364570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2794-f9ec-4a75-b055-0ef1d0d74499 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:22.367679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:22.368599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:45:22.369425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:22.372863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 188/359] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:22.378516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.409798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:22.463505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:22.510401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d191-31c0-45e6-a80c-8fd9e2b04437 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:22.525273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2794-f9ec-4a75-b055-0ef1d0d74499 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:22.550031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:22.550683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.550960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.551235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.563455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:22.568565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:22.568894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:22.569744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:22.570561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:22.571177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.571177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.571177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.571381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 189/360] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:22.571381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.660674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:22.661954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:22.694724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:22.714335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde742c-92d2-4ded-b21d-b6bfcfef32bf None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:22.748019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:22.764091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1ac70-14cb-4aa9-a023-66377700ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:22.764701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1ac70-14cb-4aa9-a023-66377700ed6f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.764973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1ac70-14cb-4aa9-a023-66377700ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.765233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1ac70-14cb-4aa9-a023-66377700ed6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.765958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1ac70-14cb-4aa9-a023-66377700ed6f None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=8bb219ecae85425b811774a579941e97, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:22.766255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1ac70-14cb-4aa9-a023-66377700ed6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:22.768339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1ac70-14cb-4aa9-a023-66377700ed6f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:22.779562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 190/361] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:22 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=8bb219ecae85425b811774a579941e97 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:22.781019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ace28-2e97-4cb2-bb70-c8e8e2e733ab None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:22.781614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ace28-2e97-4cb2-bb70-c8e8e2e733ab None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:22.781886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ace28-2e97-4cb2-bb70-c8e8e2e733ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:22.792147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 172/362] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:22.798917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.808655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-fc6ace28-2e97-4cb2-bb70-c8e8e2e733ab None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:22.809901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fc6ace28-2e97-4cb2-bb70-c8e8e2e733ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:22.913062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 191/363] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:22.917783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ace28-2e97-4cb2-bb70-c8e8e2e733ab None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:22.977559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db32cc9-22f6-4c3b-b27f-4cc2582490b7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.032531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.034303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.035408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.036090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.037713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:23.038677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:23.041073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:23.056215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 173/364] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:23.058263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.074609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:23.112896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:23.114988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ace28-2e97-4cb2-bb70-c8e8e2e733ab None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.184617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.185703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.186181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.186650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.187547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:23.188071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:23.190926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:23.209818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 192/365] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:23.211014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.254981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b73da-d3f5-431c-bff0-1e34f12b8757 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.313876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.314691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.314968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.315233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.325229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:23.326913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:23.330754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 174/366] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:23.331863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.371854 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2466fb0-d9de-481e-898a-6259310a0579 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.411276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.411961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.412468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.412909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] PATH_INFO: `/v3/users/00c291ce1b114aab8e93bf4edcc937a3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.414752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] RBAC: Authorizing `identity:get_user(user_id=00c291ce1b114aab8e93bf4edcc937a3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:23.416658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:23.418670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 193/367] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/users/00c291ce1b114aab8e93bf4edcc937a3 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:23.419880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.431655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:23.450027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7caf0-3846-4312-83e6-d9e163644535 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.468116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:23.487958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.488575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.488848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.489109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.542282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22debd7-c400-4426-8897-81c67eedd82c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.569323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:23.570765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:23.582225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.583310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.583828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.584300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.598408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:23.605447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:23.606368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:23.607231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:23.609328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 194/368] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:23.610307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.681812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:23.690501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 175/369] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:23.691073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:23.691381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.734956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c24fc9-1ccc-4bc2-9163-3d413719fe65 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.778019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.778776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.779096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.779364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.781475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:23.783299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:23.785783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 195/370] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:23.786545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.829476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e9ed3-97c0-4f3f-9f25-06faebd40fd2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:23.873689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:23.874915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:23.875376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:23.875812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:23.876731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] RBAC: Adding query filter params (role.id=88530fd398e84e9fa2d058a50b2ee980, user.id=00c291ce1b114aab8e93bf4edcc937a3, scope.system=all) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:23.877753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:23.879333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:23.895436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 176/371] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/role_assignments?user.id=00c291ce1b114aab8e93bf4edcc937a3&scope.system=all&role.id=88530fd398e84e9fa2d058a50b2ee980 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:23.896618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:23.970622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e61885-d807-4b2b-822d-dad07fc2851d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:24.001062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:24.063487 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eb6dd-0fb7-4ba9-b635-fb1ffdf82ec2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:24.072501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:24.073151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.073431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.073700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.074388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:24.074687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:24.076168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:24.083430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:24.099997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 196/372] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:24.100840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:24.131811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:24.132857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.133227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.133588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.135118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:24.137324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:24.139805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 177/373] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:23 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:24.140790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:24.274446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94556d4-b29c-4aa7-9261-a8346d3b245d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:24.280784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62237c56-eccf-474d-a5cc-a7354d312e4b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:24.304498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:24.313849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:24.314436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.314865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.315223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.315988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=8012cf29932d4c079428afdbfd3d8dff) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:24.316383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:24.317927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:24.325055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451e460-0d27-426e-9133-1cd8137ef50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:24.326226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e460-0d27-426e-9133-1cd8137ef50e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.326731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e460-0d27-426e-9133-1cd8137ef50e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.326842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 197/374] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:24 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:24.327225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451e460-0d27-426e-9133-1cd8137ef50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.330231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:24.446264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:24.502261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f14fa9-f45f-4d1e-b7e1-946255818af2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:24.508643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451e460-0d27-426e-9133-1cd8137ef50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:24.510307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451e460-0d27-426e-9133-1cd8137ef50e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:24.550668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:24.551236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.551510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.551793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.553148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:24.554597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:24.563205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 198/375] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:24 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:24.566422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:24.680689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 178/376] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:24.682063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b781c-e7e4-4591-ac8d-18294e4a9d68 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.682345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b781c-e7e4-4591-ac8d-18294e4a9d68 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.682605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b781c-e7e4-4591-ac8d-18294e4a9d68 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.685427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 179/377] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:24.691359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0d0f-e313-49cb-b34a-3c80c003a0d4 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.691948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0d0f-e313-49cb-b34a-3c80c003a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.692310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f0d0f-e313-49cb-b34a-3c80c003a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.713214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c20f0d0f-e313-49cb-b34a-3c80c003a0d4 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:24.714151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969884d-b3a2-4f15-892c-8cf00e8895be None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:24.714663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c20f0d0f-e313-49cb-b34a-3c80c003a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:24.737409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:24.754577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:24.761549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:24.762524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.763003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.763410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.764507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=8bb219ecae85425b811774a579941e97, scope.project.id=8012cf29932d4c079428afdbfd3d8dff) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:24.764962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:24.766568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:24.774747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 199/378] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:24 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=8bb219ecae85425b811774a579941e97 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:24.775801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:24.834432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 180/379] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:24.901077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf36d1-67c0-4755-868e-e8ad93c68b98 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:24.939518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:24.940458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:24.940866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:24.941264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] PATH_INFO: `/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:24.942622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] RBAC: Authorizing `identity:get_project(project_id=f45a231e90ab44d5b27215f7d1c94ccd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:24.944311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:24.946180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 200/380] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:24 2022] GET /identity/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:24.953937 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f0d0f-e313-49cb-b34a-3c80c003a0d4 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:25.076871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f0d0f-e313-49cb-b34a-3c80c003a0d4 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:25.114114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c223513-aa3f-448d-93bf-ab7041e1fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:25.114778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c223513-aa3f-448d-93bf-ab7041e1fe7f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:25.115048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c223513-aa3f-448d-93bf-ab7041e1fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:25.115366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c223513-aa3f-448d-93bf-ab7041e1fe7f None admin] PATH_INFO: `/v3/groups/53c30fa587914bcd935df5e73c937ca8` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:25.124222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c223513-aa3f-448d-93bf-ab7041e1fe7f None admin] RBAC: Authorizing `identity:get_group(group_id=53c30fa587914bcd935df5e73c937ca8)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:25.126010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c223513-aa3f-448d-93bf-ab7041e1fe7f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:25.128128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 181/381] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:24 2022] GET /identity/v3/groups/53c30fa587914bcd935df5e73c937ca8 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:25.134255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:25.208978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:25.258231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679653ef-7045-4e8b-8db6-10dc73931af3 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:25.258548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679653ef-7045-4e8b-8db6-10dc73931af3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:25.258774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679653ef-7045-4e8b-8db6-10dc73931af3 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:25.260425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 182/382] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:25.267187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dec30-c728-4bce-aa64-358fa7df39c2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:25.267542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dec30-c728-4bce-aa64-358fa7df39c2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:25.267840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dec30-c728-4bce-aa64-358fa7df39c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:25.271910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ef46a-4703-49a5-bbdb-f0ee35d6519f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:25.298559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5d8dec30-c728-4bce-aa64-358fa7df39c2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:25.300441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5d8dec30-c728-4bce-aa64-358fa7df39c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:25.317391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:25.335071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:25.336084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:25.336420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:25.336683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:25.337534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] RBAC: Adding query filter params (group.id=53c30fa587914bcd935df5e73c937ca8, role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=f45a231e90ab44d5b27215f7d1c94ccd) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:25.338147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:25.340183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:25.348758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 201/383] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:25 2022] GET /identity/v3/role_assignments?group.id=53c30fa587914bcd935df5e73c937ca8&scope.project.id=f45a231e90ab44d5b27215f7d1c94ccd&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:25.349598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:25.482558 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 183/384] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:25.492233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f481bd-bc76-4f81-ab4c-3670150a9da3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:25.528032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:25.549856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:25.550514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:25.550788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:25.551048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:25.567205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:25.572844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:25.573811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:25.574594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:25.576641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 202/385] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:25.582691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dec30-c728-4bce-aa64-358fa7df39c2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:25.698381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dec30-c728-4bce-aa64-358fa7df39c2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:25.733749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:25.734361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:25.734633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:25.734895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:25.735552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:25.735862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:25.737563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:25.750885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 184/386] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:25.756283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:25.798937 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:25.809817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:25.883833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad157e-04e8-44ba-9e03-603c1695a54c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:25.942761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:25.943391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:25.943660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:25.944916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:25.945768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:25.947344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:25.949582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 203/387] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:25 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:25.951902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0377ee-5e91-4761-9ca6-ac676ba2dca2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:25.957024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:26.000628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:26.001276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:26.001546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:26.001808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:26.025646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:26.034897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:26.035830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:26.036594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 185/388] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:26.054282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:26.057973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:26.151522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aacb86-c727-434a-aff7-2b73c7700e3b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:26.175552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:26.216504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:26.217584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:26.218049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:26.218514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:26.219871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:26.222191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:26.224358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 204/389] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:25 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:26.231183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:26.239943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee521e-16e4-46e3-acf3-a432ad9b65c8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:26.294659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:26.295288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:26.295568 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:26.295864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:26.296536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:26.296837 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:26.298234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:26.318312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 186/390] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:26.324217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:26.401743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71547f71-da35-48d5-a0be-908772f6e1fc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:26.426622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:26.440640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bb664-37f3-4ee4-903a-091c148f17c5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:26.460456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:26.461146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:26.461423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:26.461693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:26.465974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a78b258ad24b42b5759483dd69f2ff, group_id=2481e33fc9844037bff73a6fdf6ac358, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:26.468307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:26.474399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:26.484892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:26.485887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:26.486348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:26.487176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:26.488862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:26.491085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:26.493350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 187/391] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:26 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:26.499387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:26.502259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 205/392] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Sep 15 12:45:26 2022] PUT /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:26.634489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e082563-f69e-4861-9dd3-8ae6671c745d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:26.678808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92c121-19ce-4659-ba2a-1f431f1f49c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:26.679838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c121-19ce-4659-ba2a-1f431f1f49c5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:26.680298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c121-19ce-4659-ba2a-1f431f1f49c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:26.680727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c121-19ce-4659-ba2a-1f431f1f49c5 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:26.684592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92c121-19ce-4659-ba2a-1f431f1f49c5 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:26.686546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92c121-19ce-4659-ba2a-1f431f1f49c5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:26.688873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 188/393] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:26 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:26.701666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:26.853814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c4aa9-2658-47bf-b547-b55db408a7a7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:26.905207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356579b-96cf-429c-82a0-250283e4917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:26.906181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356579b-96cf-429c-82a0-250283e4917a None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:26.906621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356579b-96cf-429c-82a0-250283e4917a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:26.907056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356579b-96cf-429c-82a0-250283e4917a None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/8bb219ecae85425b811774a579941e97` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:26.909385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356579b-96cf-429c-82a0-250283e4917a None admin] RBAC: Authorizing `identity:create_grant(project_id=e3a78b258ad24b42b5759483dd69f2ff, group_id=2481e33fc9844037bff73a6fdf6ac358, role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:26.911013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356579b-96cf-429c-82a0-250283e4917a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:26.928562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 206/394] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Sep 15 12:45:26 2022] PUT /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/8bb219ecae85425b811774a579941e97 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:27.397549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20470-52a6-49be-89f1-31dfc14128a4 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:27.398563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20470-52a6-49be-89f1-31dfc14128a4 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:27.399051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb20470-52a6-49be-89f1-31dfc14128a4 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:27.401096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 189/395] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:27.406867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac5d4-2e81-4c1d-9f64-412f14601f71 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:27.407299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac5d4-2e81-4c1d-9f64-412f14601f71 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:27.407389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac5d4-2e81-4c1d-9f64-412f14601f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:27.448733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-68bac5d4-2e81-4c1d-9f64-412f14601f71 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:27.449952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-68bac5d4-2e81-4c1d-9f64-412f14601f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:27.494526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:27.541489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 207/396] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:27.613542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf67f8-2135-417d-8abb-a658529501ef None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:27.613912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf67f8-2135-417d-8abb-a658529501ef None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:27.614075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf67f8-2135-417d-8abb-a658529501ef None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:27.615831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 190/397] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:27.621174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8f60-b33b-4799-a932-2678b8b3f2ab None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:27.621458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8f60-b33b-4799-a932-2678b8b3f2ab None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:27.621726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8f60-b33b-4799-a932-2678b8b3f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:27.640157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-63be8f60-b33b-4799-a932-2678b8b3f2ab None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:27.641325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-63be8f60-b33b-4799-a932-2678b8b3f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:27.740766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 208/398] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:27.973876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf67f8-2135-417d-8abb-a658529501ef None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.053692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:28.100779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf67f8-2135-417d-8abb-a658529501ef None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.138393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.139177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.139453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.141585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be8f60-b33b-4799-a932-2678b8b3f2ab None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.141772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.161198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:28.166404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:28.167284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:28.172508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 191/399] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:28.181655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.272423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be8f60-b33b-4799-a932-2678b8b3f2ab None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.275119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:28.314049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85505be8-ce48-4ea5-bf98-f119d6fd7f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.314725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505be8-ce48-4ea5-bf98-f119d6fd7f27 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.315005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505be8-ce48-4ea5-bf98-f119d6fd7f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.315272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85505be8-ce48-4ea5-bf98-f119d6fd7f27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.327490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85505be8-ce48-4ea5-bf98-f119d6fd7f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:28.328233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f1fa6-f105-49f4-817b-6493055c7db7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-85505be8-ce48-4ea5-bf98-f119d6fd7f27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:28.332648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:28.333520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:28.334311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:28.338733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 209/400] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:28.340125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fc54-cc12-43be-917e-a87ae56f17c3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.340408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fc54-cc12-43be-917e-a87ae56f17c3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.340677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fc54-cc12-43be-917e-a87ae56f17c3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.342744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 210/401] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:28.343442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191fc54-cc12-43be-917e-a87ae56f17c3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.358997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:28.371809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d204-fb6b-40a9-94bc-2e634d699ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.372779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d204-fb6b-40a9-94bc-2e634d699ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.373696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d204-fb6b-40a9-94bc-2e634d699ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.374176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d204-fb6b-40a9-94bc-2e634d699ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.375295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d204-fb6b-40a9-94bc-2e634d699ec1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:28.375814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d204-fb6b-40a9-94bc-2e634d699ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:28.377380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d204-fb6b-40a9-94bc-2e634d699ec1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:28.391335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 192/402] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:28.391335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0ea25-af7a-4fc7-a3a9-b387930f2966 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.391335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0ea25-af7a-4fc7-a3a9-b387930f2966 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.391335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0ea25-af7a-4fc7-a3a9-b387930f2966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.413704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-03e0ea25-af7a-4fc7-a3a9-b387930f2966 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:28.415849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-03e0ea25-af7a-4fc7-a3a9-b387930f2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:28.476230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191fc54-cc12-43be-917e-a87ae56f17c3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.491054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 193/403] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:28.492230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0ea25-af7a-4fc7-a3a9-b387930f2966 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.544612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.545240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.545516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.545780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.546451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:28.546748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:28.548162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:28.563664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 211/404] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:28.569173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.601227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0ea25-af7a-4fc7-a3a9-b387930f2966 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.619334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:28.622474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:28.643686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.644732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.645198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.645649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.647489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:28.649198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:28.651371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 194/405] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:28.665240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.717984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4675730-8989-4485-ad1a-af4f2d7d5ba3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.753554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.754199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.754475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.754758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.756047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:28.757386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:28.759266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 212/406] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:28.768032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.859670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:28.869547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0937-4700-45b3-99b6-1b553c6cd24a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.877186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22488c5-8875-4961-8aff-68b80d549518 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:28.905769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.906411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.906685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.906951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.908104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:28.909538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:28.911477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 213/407] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:28.917235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:28.951514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:28.952529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:28.953015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:28.953470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:28.954811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:28.956461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:28.958580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 195/408] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:28.959547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:29.016126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:29.022087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148025-9c82-4e7e-a163-c2a63186b90d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:29.058077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:29.058626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.058907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.059187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/8bb219ecae85425b811774a579941e97` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.062016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] RBAC: Authorizing `identity:create_grant(project_id=8012cf29932d4c079428afdbfd3d8dff, group_id=2481e33fc9844037bff73a6fdf6ac358, role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:29.062516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1291-fea9-4d9a-a7f7-33e07a12771a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:29.063561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:29.080778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 214/409] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Sep 15 12:45:28 2022] PUT /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/8bb219ecae85425b811774a579941e97 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:29.088375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:29.100585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:29.101532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.101974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.102438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.115232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:29.121828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:29.122814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:29.123577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:29.126429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 196/410] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:45:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:29.132651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:29.134717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:29.256749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055983c-f118-4879-a95b-f7dc1e86a4fe None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:29.276692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:29.299944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:29.300953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.301409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.301808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.302673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:29.303198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:29.304934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:29.315728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 197/411] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:29.321952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:29.353036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77fe6d-2dff-4ea8-9129-c18a3129d074 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:29.390423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea60a40-07e8-41dc-8d6e-856340eb66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:29.391000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea60a40-07e8-41dc-8d6e-856340eb66d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.391273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea60a40-07e8-41dc-8d6e-856340eb66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.391676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea60a40-07e8-41dc-8d6e-856340eb66d6 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.394681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea60a40-07e8-41dc-8d6e-856340eb66d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8012cf29932d4c079428afdbfd3d8dff, group_id=2481e33fc9844037bff73a6fdf6ac358, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:29.396571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea60a40-07e8-41dc-8d6e-856340eb66d6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:29.416308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 215/412] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Sep 15 12:45:29 2022] PUT /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff/groups/2481e33fc9844037bff73a6fdf6ac358/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:29.417588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99648-f36f-4afa-a757-3b19fd30796f None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.417871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99648-f36f-4afa-a757-3b19fd30796f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.418138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f99648-f36f-4afa-a757-3b19fd30796f None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.419671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 216/413] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:29.433994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a94c-e92a-4a02-90ce-ea79f5ec4841 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.434460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a94c-e92a-4a02-90ce-ea79f5ec4841 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.434875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165a94c-e92a-4a02-90ce-ea79f5ec4841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.461225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6165a94c-e92a-4a02-90ce-ea79f5ec4841 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:29.463562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6165a94c-e92a-4a02-90ce-ea79f5ec4841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:29.465614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ddd4-06a1-44b1-a109-6419347d0a6e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:29.514329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:29.515282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.515767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.516194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] PATH_INFO: `/v3/groups/53c30fa587914bcd935df5e73c937ca8` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.517543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] RBAC: Authorizing `identity:get_group(group_id=53c30fa587914bcd935df5e73c937ca8)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:29.519805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:29.522768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 198/414] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:29 2022] GET /identity/v3/groups/53c30fa587914bcd935df5e73c937ca8 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:29.530050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:29.554258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 217/415] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:29.584486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:29.651091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c995bd-c9cf-4651-8597-39c7a84cfb99 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:29.695536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c10f65-5f65-41b2-82ed-6c701bbdba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:29.696573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10f65-5f65-41b2-82ed-6c701bbdba51 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.697014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10f65-5f65-41b2-82ed-6c701bbdba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.697488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c10f65-5f65-41b2-82ed-6c701bbdba51 None admin] PATH_INFO: `/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.698855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c10f65-5f65-41b2-82ed-6c701bbdba51 None admin] RBAC: Authorizing `identity:get_project(project_id=f45a231e90ab44d5b27215f7d1c94ccd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:29.700729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c10f65-5f65-41b2-82ed-6c701bbdba51 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:29.703196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 199/416] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:29 2022] GET /identity/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:29.712047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165a94c-e92a-4a02-90ce-ea79f5ec4841 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:29.732261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:29.757274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54d9c-727f-4814-b3e6-55be112d3ba5 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.757587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54d9c-727f-4814-b3e6-55be112d3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.757777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54d9c-727f-4814-b3e6-55be112d3ba5 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.759384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 200/417] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:29.765461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3e32a-dc5a-4b61-a573-79ff1ffdd06f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.765737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3e32a-dc5a-4b61-a573-79ff1ffdd06f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.766017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3e32a-dc5a-4b61-a573-79ff1ffdd06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.788899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2ce3e32a-dc5a-4b61-a573-79ff1ffdd06f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:29.790403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2ce3e32a-dc5a-4b61-a573-79ff1ffdd06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:29.861076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165a94c-e92a-4a02-90ce-ea79f5ec4841 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:29.875534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 201/418] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:29.876738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3e32a-dc5a-4b61-a573-79ff1ffdd06f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:29.913404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:29.914050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:29.914319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:29.914585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] PATH_INFO: `/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd/groups/53c30fa587914bcd935df5e73c937ca8/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:29.917705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f45a231e90ab44d5b27215f7d1c94ccd, group_id=53c30fa587914bcd935df5e73c937ca8, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:29.921769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:29.945580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 218/419] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Sep 15 12:45:29 2022] PUT /identity/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd/groups/53c30fa587914bcd935df5e73c937ca8/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:29.984228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.025889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3e32a-dc5a-4b61-a573-79ff1ffdd06f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:30.067035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:30.067716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:30.068010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:30.068270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:30.080296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:30.085345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:30.086266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:30.087060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 202/420] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:30.092830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:30.190016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.227288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4532-a482-492a-9fcc-c905c7b44fa2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:30.266055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:30.266659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:30.266986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:30.267249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:30.267989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] RBAC: Adding query filter params (name=member) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:30.268338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:30.269780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:30.278841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 219/421] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:30.284365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:30.329790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:30.393817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.397755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8806a-f135-4609-a339-e4a85500b78d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:30.447510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:30.447510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:30.452577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:30.452723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:30.497149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6128d25-11b6-4f04-b419-89498cd5361a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:30.552304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.561665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:30.562395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:30.562634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:30.562905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:30.577019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:30.580552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:30.583843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:30.594267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:30.595162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:30.596045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 220/422] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:30.603182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:30.712756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c777b-7974-45da-8ff6-f03ff0aea54a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:30.758136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:30.758813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:30.759022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:30.759273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:30.759975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:30.760264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:30.761743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:30.762869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.767103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 203/423] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:30.772926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:30.784156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 221/424] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:30.789841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:30.900028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:30.950846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f915f6-d744-4bf4-9733-9c476614314b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:30.979775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fbc5-e3be-49bd-ab03-796b893ec9cc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:31.017031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:31.017645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.017918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.018183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.049369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:31.050464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.050951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.051403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.055376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:31.057275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:31.059500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 204/425] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:30 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:31.065505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:31.092923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:31.094796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:31.152213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:31.199739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 222/426] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:45:31.203321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:31.208963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:31.274106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10a38-f15c-4f0f-81d1-a6c0cff80a43 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:31.337844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:31.338942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.339216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.339808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.341110 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:31.342942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:31.345013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 205/427] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:31 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:31.350741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:31.406456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febe324-853a-4991-9123-06e5aa027405 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:31.468184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e899eca-987d-44d1-95a9-d96245c8ee20 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:31.504709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:31.505320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.505591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.505853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.506572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:31.506871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:31.508325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:31.511147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:31.515532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 206/428] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:31 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:31.518093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:31.518746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.519018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.519280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] PATH_INFO: `/v3/projects/e3a78b258ad24b42b5759483dd69f2ff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.520444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] RBAC: Authorizing `identity:get_project(project_id=e3a78b258ad24b42b5759483dd69f2ff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:31.521925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:31.523971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 223/429] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:31 2022] GET /identity/v3/projects/e3a78b258ad24b42b5759483dd69f2ff => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:31.530211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:31.672929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8ec12-8881-4cc3-9de2-b482ee8fe9d9 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:31.710480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72784fc-bee2-4ddc-8fa5-ee15085b6f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:31.711135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72784fc-bee2-4ddc-8fa5-ee15085b6f8e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.711405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72784fc-bee2-4ddc-8fa5-ee15085b6f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.711667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72784fc-bee2-4ddc-8fa5-ee15085b6f8e None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.712880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72784fc-bee2-4ddc-8fa5-ee15085b6f8e None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:31.714328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72784fc-bee2-4ddc-8fa5-ee15085b6f8e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:31.716399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 207/430] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:31 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:31.724832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:31.765353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:31.782067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5f8e7-0165-4495-9fa5-a5d07d69144b None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.782253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5f8e7-0165-4495-9fa5-a5d07d69144b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.782512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5f8e7-0165-4495-9fa5-a5d07d69144b None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.784158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 208/431] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:31.789106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac854b-49b0-4a30-a56e-764cb7c43ddc None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.789503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac854b-49b0-4a30-a56e-764cb7c43ddc None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.789919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac854b-49b0-4a30-a56e-764cb7c43ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.811478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5eac854b-49b0-4a30-a56e-764cb7c43ddc None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:31.812814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5eac854b-49b0-4a30-a56e-764cb7c43ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:31.851946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c4018-80db-4463-b50f-8ef296e4d2b5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:31.885639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:31.892030 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 209/432] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:31.897782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e926b-0e4d-433f-9fa6-3dd9bbd00a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:31.898442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e926b-0e4d-433f-9fa6-3dd9bbd00a3c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:31.898716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e926b-0e4d-433f-9fa6-3dd9bbd00a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:31.898977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e926b-0e4d-433f-9fa6-3dd9bbd00a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:31.899718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e926b-0e4d-433f-9fa6-3dd9bbd00a3c None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=8bb219ecae85425b811774a579941e97, scope.project.id=e3a78b258ad24b42b5759483dd69f2ff) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:31.900051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e926b-0e4d-433f-9fa6-3dd9bbd00a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:31.901481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e926b-0e4d-433f-9fa6-3dd9bbd00a3c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:31.908263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 224/433] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:31 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=e3a78b258ad24b42b5759483dd69f2ff&role.id=8bb219ecae85425b811774a579941e97 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:32.115233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c944d-8d85-496f-8429-4413660e4937 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.115612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c944d-8d85-496f-8429-4413660e4937 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.115824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c944d-8d85-496f-8429-4413660e4937 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.117323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 210/434] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:32.122665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d988a-8d6c-4936-9982-fcd295adfc76 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.122947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d988a-8d6c-4936-9982-fcd295adfc76 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.123214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d988a-8d6c-4936-9982-fcd295adfc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3b7d988a-8d6c-4936-9982-fcd295adfc76 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:32.143857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3b7d988a-8d6c-4936-9982-fcd295adfc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:32.177875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c944d-8d85-496f-8429-4413660e4937 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:32.219546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 225/435] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:32.301160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c944d-8d85-496f-8429-4413660e4937 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:32.336482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:32.337173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.337444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.337703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.349122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:32.354196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:32.355060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:32.355893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 211/436] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:32.362073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d988a-8d6c-4936-9982-fcd295adfc76 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:32.381603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:32.466764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d988a-8d6c-4936-9982-fcd295adfc76 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:32.489685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:32.503489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:32.504131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.504400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.505795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.505795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:32.505795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:32.507014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:32.516266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 226/437] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:32.522742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:32.565002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:32.619488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6dc9b-0a92-49d2-8561-c78f61b5197b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:32.628370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:32.652146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c921ea8-82e2-44ca-8e34-c389032b39ff None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:32.661130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:32.661770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.662040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.662304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.674452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:32.680910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:32.681802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:32.682593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 212/438] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:32.688070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:32.689168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38268245-c1be-476a-9c32-bb970b2045df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:32.689761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38268245-c1be-476a-9c32-bb970b2045df None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.690037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38268245-c1be-476a-9c32-bb970b2045df None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.690300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38268245-c1be-476a-9c32-bb970b2045df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.758865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38268245-c1be-476a-9c32-bb970b2045df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:32.760353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38268245-c1be-476a-9c32-bb970b2045df None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:32.788848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1feb3b-b86d-49e8-ac0f-c069f8936c75 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:32.805962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:32.823485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d6fe8-afe5-4bf6-8547-4442a6e49eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:32.824130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d6fe8-afe5-4bf6-8547-4442a6e49eeb None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.824411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d6fe8-afe5-4bf6-8547-4442a6e49eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.824679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d6fe8-afe5-4bf6-8547-4442a6e49eeb None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.825367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d6fe8-afe5-4bf6-8547-4442a6e49eeb None admin] RBAC: Adding query filter params (name=member) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:32.825660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d6fe8-afe5-4bf6-8547-4442a6e49eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:32.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d6fe8-afe5-4bf6-8547-4442a6e49eeb None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:32.835099 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 213/439] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:45:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:32.836294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699fe22-9db5-484a-968d-3b906bede518 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.836576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699fe22-9db5-484a-968d-3b906bede518 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.836876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699fe22-9db5-484a-968d-3b906bede518 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.838029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 214/440] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:32.840807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699fe22-9db5-484a-968d-3b906bede518 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:32.841993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:32.865687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 227/441] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:45:32.866991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542e6e-af76-4066-8ee7-70787e55e2a8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.867275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542e6e-af76-4066-8ee7-70787e55e2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.867549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542e6e-af76-4066-8ee7-70787e55e2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:32.885288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-99542e6e-af76-4066-8ee7-70787e55e2a8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:32.886467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-99542e6e-af76-4066-8ee7-70787e55e2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:32.942988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699fe22-9db5-484a-968d-3b906bede518 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:32.951068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 228/442] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:32.952001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542e6e-af76-4066-8ee7-70787e55e2a8 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:32.988633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:32.989309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:32.989590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:32.989857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.043337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:33.056386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542e6e-af76-4066-8ee7-70787e55e2a8 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.066301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:33.067744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.069266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.093007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.093642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.093917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.094387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.095295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.096736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.102895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 229/443] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:32 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:33.103856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.182478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 215/444] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:45:33.183532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.208802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a54b4-86dc-4749-bacd-72e852f7ee28 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.244038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.244660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.244935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.245190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.246274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.247995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.249554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 230/445] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:33.250295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.263863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:33.283206 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5094e3-2344-41c0-982d-e22dc48ec982 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.295101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:33.316413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.317037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.317299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.317564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] PATH_INFO: `/v3/projects/8012cf29932d4c079428afdbfd3d8dff` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.318644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] RBAC: Authorizing `identity:get_project(project_id=8012cf29932d4c079428afdbfd3d8dff)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.320104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.321691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 216/446] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/projects/8012cf29932d4c079428afdbfd3d8dff => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:33.322427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.350995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1d27-a3e5-4f18-be3a-3c002c67299b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.385326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.385950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.386207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.386466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.397500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:33.402356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:33.403952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 231/447] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:33.404790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.424500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8848-c5ce-472b-8326-de13320a7738 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.461358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.462398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.462817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.463543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.464731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=8bb219ecae85425b811774a579941e97, scope.project.id=8012cf29932d4c079428afdbfd3d8dff) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:33.465180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.467141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.487743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 217/448] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=8bb219ecae85425b811774a579941e97 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:33.487743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.504656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:33.577788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c85e4d-d494-47cc-9b1d-490b19016b88 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.587725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:33.625685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.626847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.627403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.627675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] PATH_INFO: `/v3/groups/2481e33fc9844037bff73a6fdf6ac358` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.629273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] RBAC: Authorizing `identity:get_group(group_id=2481e33fc9844037bff73a6fdf6ac358)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.631140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.639441 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 232/449] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/groups/2481e33fc9844037bff73a6fdf6ac358 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:33.640489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.654884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb7b08-aa0c-4730-9ed0-1f88a9d6c5e5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.696340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.698093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.698409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.698676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.699712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:33.700072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.702006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.718108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 218/450] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:33.723811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:33.767735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae932f7-3dd4-44fb-a0d9-8dddd25232b2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.804491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.805099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.805371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.806349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.806349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] RBAC: Adding query filter params (group.id=2481e33fc9844037bff73a6fdf6ac358, role.id=49776df6eca74fe69bb7b4b1a3cfb7cd, scope.project.id=8012cf29932d4c079428afdbfd3d8dff) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:33.806633 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.808108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:33.811394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:33.814769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 233/451] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/role_assignments?group.id=2481e33fc9844037bff73a6fdf6ac358&scope.project.id=8012cf29932d4c079428afdbfd3d8dff&role.id=49776df6eca74fe69bb7b4b1a3cfb7cd => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:33.837395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049ba4b-8775-41c7-b4fe-ced0c71a1b1d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:33.873961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:33.874598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:33.874872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:33.875135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:33.958783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:33.960288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:34.038909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:34.064250 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 219/452] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:45:34.070168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:34.109771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:34.194841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253aa98-a9d4-4f6d-ad40-c189c31f2911 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:34.237921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:34.238685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:34.238960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:34.239225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] PATH_INFO: `/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:34.240624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] RBAC: Authorizing `identity:get_project(project_id=f45a231e90ab44d5b27215f7d1c94ccd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:34.241898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:34.243994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 234/453] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:45:34 2022] GET /identity/v3/projects/f45a231e90ab44d5b27215f7d1c94ccd => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:34.250476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:34.353381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55354744-1077-4030-bb66-07dc6776dd6d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:34.386684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc628c-3643-4ff6-abc2-de55fa7043cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:34.387320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc628c-3643-4ff6-abc2-de55fa7043cd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:34.387622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc628c-3643-4ff6-abc2-de55fa7043cd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:34.387934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc628c-3643-4ff6-abc2-de55fa7043cd None admin] PATH_INFO: `/v3/groups/53c30fa587914bcd935df5e73c937ca8` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:34.389021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc628c-3643-4ff6-abc2-de55fa7043cd None admin] RBAC: Authorizing `identity:get_group(group_id=53c30fa587914bcd935df5e73c937ca8)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:34.390473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc628c-3643-4ff6-abc2-de55fa7043cd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:34.392104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 220/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Sep 15 12:45:34 2022] GET /identity/v3/groups/53c30fa587914bcd935df5e73c937ca8 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:34.398249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:34.505700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c111b1-2262-4a18-958e-bde1acb208d6 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:34.508055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:34.541002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3767b-7b57-4a56-8a8b-cdcea6cb3b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:34.541603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3767b-7b57-4a56-8a8b-cdcea6cb3b73 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:34.541878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3767b-7b57-4a56-8a8b-cdcea6cb3b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:34.542145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3767b-7b57-4a56-8a8b-cdcea6cb3b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:34.542871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3767b-7b57-4a56-8a8b-cdcea6cb3b73 None admin] RBAC: Adding query filter params (group.id=53c30fa587914bcd935df5e73c937ca8, role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=f45a231e90ab44d5b27215f7d1c94ccd) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:34.543179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3767b-7b57-4a56-8a8b-cdcea6cb3b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:34.544673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3767b-7b57-4a56-8a8b-cdcea6cb3b73 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:34.550547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 235/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Sep 15 12:45:34 2022] GET /identity/v3/role_assignments?group.id=53c30fa587914bcd935df5e73c937ca8&scope.project.id=f45a231e90ab44d5b27215f7d1c94ccd&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:37.108176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3b4cd-b424-41cd-b42c-e6e58e2fd4d7 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.109292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3b4cd-b424-41cd-b42c-e6e58e2fd4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.109763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3b4cd-b424-41cd-b42c-e6e58e2fd4d7 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.111936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 221/456] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:37.117416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ebb77-812c-4df4-8796-497e7fa967c3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.118335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ebb77-812c-4df4-8796-497e7fa967c3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.118802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ebb77-812c-4df4-8796-497e7fa967c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.148695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0f4ebb77-812c-4df4-8796-497e7fa967c3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:37.150298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0f4ebb77-812c-4df4-8796-497e7fa967c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:37.236867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 236/457] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:37.591994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367310-dc5f-4db0-a173-342fd4141a35 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.592266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367310-dc5f-4db0-a173-342fd4141a35 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.592757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367310-dc5f-4db0-a173-342fd4141a35 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.594521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 222/458] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:37.613858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85145-89e5-42e4-99df-14bc12637eb4 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.614431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85145-89e5-42e4-99df-14bc12637eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.614913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f85145-89e5-42e4-99df-14bc12637eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.644710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-81f85145-89e5-42e4-99df-14bc12637eb4 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:37.646232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-81f85145-89e5-42e4-99df-14bc12637eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:37.673806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367310-dc5f-4db0-a173-342fd4141a35 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:37.741815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 237/459] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:37.743471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5b0f-f69b-4bda-ae54-edffea3bedfa None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.743968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5b0f-f69b-4bda-ae54-edffea3bedfa None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.744427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a5b0f-f69b-4bda-ae54-edffea3bedfa None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.746114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 238/460] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:37.747908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:37.761161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cedda-03c7-4257-9587-2db6ec5a1be8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.761739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cedda-03c7-4257-9587-2db6ec5a1be8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.762250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cedda-03c7-4257-9587-2db6ec5a1be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.796577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-135cedda-03c7-4257-9587-2db6ec5a1be8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:37.798103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-135cedda-03c7-4257-9587-2db6ec5a1be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:37.820194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a367310-dc5f-4db0-a173-342fd4141a35 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:37.847171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:37.864066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:37.865131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.865554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.865981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.878529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:37.880275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:37.896768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:37.897742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:37.898583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:37.898583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:37.898583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:37.904882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 223/461] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:37.907852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:37.948476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 239/462] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:37.973256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe934d-bb54-46b2-a139-2757c1943ee3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.973880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe934d-bb54-46b2-a139-2757c1943ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.974355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe934d-bb54-46b2-a139-2757c1943ee3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:37.976153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 240/463] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:37.989379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6da2-e909-4bef-b2c0-8f9fa9aa1af5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:37.989995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6da2-e909-4bef-b2c0-8f9fa9aa1af5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:37.990474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6da2-e909-4bef-b2c0-8f9fa9aa1af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.013891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:38.018227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abae3d-e34c-4c6c-805a-659006c3f951 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.021125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5a6d6da2-e909-4bef-b2c0-8f9fa9aa1af5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:38.022524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5a6d6da2-e909-4bef-b2c0-8f9fa9aa1af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:38.056253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.057118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.057566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.058199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.058983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:38.059602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.061369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.079853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 224/464] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:38.081949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.162743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 241/465] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:38.164237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d6da2-e909-4bef-b2c0-8f9fa9aa1af5 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.227630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f22df7-7068-42d0-8dde-d1db577dc90a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.287849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.288696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.289106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.289506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.290291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.292623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.304069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:38.324367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d6da2-e909-4bef-b2c0-8f9fa9aa1af5 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.335623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 225/466] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:38 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:38.337299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.357497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:38.371373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.372276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.372801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.372878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.387067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.388648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:38.410092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:38.411052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:38.411926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:38.411926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:38.411926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:38.411926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 242/467] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:38.419915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.499139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317279d-2641-455a-a27e-3e0b4c4c6c80 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.539503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.540118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.540515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.540784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.554466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.556117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.558536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a46317-0d3a-48c5-818d-a109cb4d57d2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:38.574481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:38.575512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:38.576791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:38.576791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:38.576791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:38.576791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 226/468] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:38.577485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.607158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.607988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.608322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.608765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.609503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:38.609787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.611533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.626586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:38.631328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 243/469] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:38.635723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.655577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:38.702231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11458363-3f0a-43d6-90d6-6fa7f071ad1b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.741039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.741711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.741948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.742216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.752472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c5225-2172-4186-b6f9-baf666a0ed1d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.755504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.756500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:38.772348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:38.773273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:38.774267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:38.774267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:38.774267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:38.774267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 227/470] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:38.774975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.787825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc25fae-a332-4cd8-bc53-6a4bdd0fb8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.788437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc25fae-a332-4cd8-bc53-6a4bdd0fb8be None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.788707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc25fae-a332-4cd8-bc53-6a4bdd0fb8be None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.788972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc25fae-a332-4cd8-bc53-6a4bdd0fb8be None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.789659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc25fae-a332-4cd8-bc53-6a4bdd0fb8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:38.789902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc25fae-a332-4cd8-bc53-6a4bdd0fb8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.791292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc25fae-a332-4cd8-bc53-6a4bdd0fb8be None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.802542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 244/471] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:38.805774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee52bf-a3a9-4fee-bc46-cd5f023742e9 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.806513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee52bf-a3a9-4fee-bc46-cd5f023742e9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.807654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee52bf-a3a9-4fee-bc46-cd5f023742e9 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.809415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 245/472] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:38.810091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee52bf-a3a9-4fee-bc46-cd5f023742e9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.878524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:38.886041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf15c1d-4cf8-4682-82cd-634f4e427740 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.903067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:38.922945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.923555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.923860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.924122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.924761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.926189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:38.933879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee52bf-a3a9-4fee-bc46-cd5f023742e9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:38.959871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 228/473] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:38 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:38.959871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:38.974333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa116cf-196b-4649-88d9-b4a68e42fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:38.974964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa116cf-196b-4649-88d9-b4a68e42fa34 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:38.975645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa116cf-196b-4649-88d9-b4a68e42fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:38.976638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa116cf-196b-4649-88d9-b4a68e42fa34 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:38.976638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa116cf-196b-4649-88d9-b4a68e42fa34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:38.977193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa116cf-196b-4649-88d9-b4a68e42fa34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:38.978917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa116cf-196b-4649-88d9-b4a68e42fa34 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:39.000030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 246/474] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:39.001474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864882d-e093-4444-9f09-e477fdc2eae7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:39.002791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864882d-e093-4444-9f09-e477fdc2eae7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:39.003068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864882d-e093-4444-9f09-e477fdc2eae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:39.028651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7864882d-e093-4444-9f09-e477fdc2eae7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:39.030863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7864882d-e093-4444-9f09-e477fdc2eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:39.103637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f11ff-c419-4bdc-8647-ab93742ac73b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:39.118275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 247/475] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:39.125126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864882d-e093-4444-9f09-e477fdc2eae7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:39.159213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:39.159878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:39.160210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:39.160409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:39.161064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:39.162513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:39.188335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:39.189571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 229/476] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:38 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:39.248203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864882d-e093-4444-9f09-e477fdc2eae7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:39.287379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:39.288352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:39.288808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:39.289285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:39.290125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:39.291801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:39.319089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 248/477] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:39 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:39.426546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:39.461687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:39.551686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c0883-525e-4304-a61c-a69830882fc5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:39.588449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:39.589410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:39.589908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:39.590511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:39.591371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:39.592957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:39.607298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.sql.core [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 12:45:39.607298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 12:45:39.607298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [parameters: {'id': 'b9f6096eed814221ad9d9d80bd036d6b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 12:45:39.607298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81588) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result.read() Sep 15 12:45:39.624790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return ref.to_dict() Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:45:39.625705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application yield resource Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise self.value Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application session.commit() Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 12:45:39.626588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.session.flush() Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application compat.raise_( Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 12:45:39.627446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:45:39.628407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result.read() Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:45:39.629289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [parameters: {'id': 'b9f6096eed814221ad9d9d80bd036d6b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:39.630052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 12:45:39.630830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:39.634843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 230/478] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Sep 15 12:45:39 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:39.643268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:39.761482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ff253-7e6b-44c1-8968-ba20a0e73f4b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:39.775163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:39.807628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ad120-709f-4517-a1c3-1a6f63bd9c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:39.808307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ad120-709f-4517-a1c3-1a6f63bd9c5b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:39.808583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ad120-709f-4517-a1c3-1a6f63bd9c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:39.808851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ad120-709f-4517-a1c3-1a6f63bd9c5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:39.826483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ad120-709f-4517-a1c3-1a6f63bd9c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-5c0ad120-709f-4517-a1c3-1a6f63bd9c5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:39.831919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:39.833884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:39.835778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 249/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:45:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:39.843823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:39.951325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:39.961872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05359b48-a892-4d81-9101-3450c3ef6bd9 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:40.009818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da1a2f-707a-45c0-a136-4f644ed2c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:40.010799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1a2f-707a-45c0-a136-4f644ed2c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:40.011293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1a2f-707a-45c0-a136-4f644ed2c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:40.011838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da1a2f-707a-45c0-a136-4f644ed2c8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:40.013334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da1a2f-707a-45c0-a136-4f644ed2c8e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:40.013845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da1a2f-707a-45c0-a136-4f644ed2c8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:40.015408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da1a2f-707a-45c0-a136-4f644ed2c8e6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:40.029129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 231/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:40.795952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde985e-411f-4996-8734-86bfc130e0e1 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:40.796450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde985e-411f-4996-8734-86bfc130e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:40.796450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde985e-411f-4996-8734-86bfc130e0e1 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:40.798067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 250/481] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:40.803046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710d7c-af35-498b-a6f5-82d2eb9fc839 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:40.803448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710d7c-af35-498b-a6f5-82d2eb9fc839 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:40.803612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710d7c-af35-498b-a6f5-82d2eb9fc839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:40.827888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-7a710d7c-af35-498b-a6f5-82d2eb9fc839 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:40.829078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7a710d7c-af35-498b-a6f5-82d2eb9fc839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:40.915214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 232/482] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:41.375111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde985e-411f-4996-8734-86bfc130e0e1 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:41.507126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde985e-411f-4996-8734-86bfc130e0e1 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:41.571073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33526899-0a41-43da-82c5-98dc27bfaa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:41.571738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33526899-0a41-43da-82c5-98dc27bfaa83 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:41.572017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33526899-0a41-43da-82c5-98dc27bfaa83 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:41.572280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33526899-0a41-43da-82c5-98dc27bfaa83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:41.591074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33526899-0a41-43da-82c5-98dc27bfaa83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-33526899-0a41-43da-82c5-98dc27bfaa83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:41.596003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:41.596886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:41.597668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 251/483] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:41.604805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710d7c-af35-498b-a6f5-82d2eb9fc839 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:41.757397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa08a5-1131-4ac6-948e-ee5dd155dd2b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:41.757580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa08a5-1131-4ac6-948e-ee5dd155dd2b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:41.757842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa08a5-1131-4ac6-948e-ee5dd155dd2b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:41.760522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 252/484] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:41.762117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:41.769300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd354395-62ee-497b-96ca-160871684e42 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:41.769643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd354395-62ee-497b-96ca-160871684e42 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:41.769850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd354395-62ee-497b-96ca-160871684e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:41.790724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-cd354395-62ee-497b-96ca-160871684e42 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:41.792118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-cd354395-62ee-497b-96ca-160871684e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:41.798965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710d7c-af35-498b-a6f5-82d2eb9fc839 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:41.834375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:41.860703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:41.861738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:41.861944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:41.862211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:41.862879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:41.863176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:41.864581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:41.887158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 233/485] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:41.892708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:41.899995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 253/486] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:41.901531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a472c-1575-4dd9-8953-75df3389ddb4 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:41.902051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a472c-1575-4dd9-8953-75df3389ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:41.902519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a472c-1575-4dd9-8953-75df3389ddb4 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:41.904436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 254/487] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:41.913156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1f8e-13d8-4554-8374-9d998bdd0386 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:41.913438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1f8e-13d8-4554-8374-9d998bdd0386 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:41.913707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1f8e-13d8-4554-8374-9d998bdd0386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:41.972675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-443a1f8e-13d8-4554-8374-9d998bdd0386 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:41.973912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-443a1f8e-13d8-4554-8374-9d998bdd0386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:42.076887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f3ad4-bd68-48ba-ae7b-7abc945a9ef6 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.122351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc84c9a-a72a-414a-81ae-5bc30d8c1e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.123022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84c9a-a72a-414a-81ae-5bc30d8c1e69 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.123296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84c9a-a72a-414a-81ae-5bc30d8c1e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.123571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc84c9a-a72a-414a-81ae-5bc30d8c1e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.125504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 255/488] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:42.143757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc84c9a-a72a-414a-81ae-5bc30d8c1e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:42.145299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc84c9a-a72a-414a-81ae-5bc30d8c1e69 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:42.152487 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-2dc84c9a-a72a-414a-81ae-5bc30d8c1e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:42.165685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:42.166662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:42.167482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:42.167482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:42.167482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:42.167482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 234/489] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:42.172835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1f8e-13d8-4554-8374-9d998bdd0386 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.209491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8ba6-4b1a-4467-97a6-cad275ee7f8f None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.209811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8ba6-4b1a-4467-97a6-cad275ee7f8f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.210028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8ba6-4b1a-4467-97a6-cad275ee7f8f None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.211500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 235/490] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:45:42.217133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f530f-0e70-4e1c-bf12-114e3091ed6a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.217409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f530f-0e70-4e1c-bf12-114e3091ed6a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.217677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f530f-0e70-4e1c-bf12-114e3091ed6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.238005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8a0f530f-0e70-4e1c-bf12-114e3091ed6a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:42.239187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8a0f530f-0e70-4e1c-bf12-114e3091ed6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:42.295406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1f8e-13d8-4554-8374-9d998bdd0386 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.310197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.317502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 236/491] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:42.319461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f530f-0e70-4e1c-bf12-114e3091ed6a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.337866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.338706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.339119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.339942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.340886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:42.341454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:42.343962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:42.366038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 256/492] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:42.371685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.467491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f530f-0e70-4e1c-bf12-114e3091ed6a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.497211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.507033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.507673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.507974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.508299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.520797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:42.526925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:42.528471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:42.529284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 237/493] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:42.530395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.564061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dea730-5eb1-4ed4-972a-bc4899b8ea26 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.615711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.616746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.617214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.617669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.628704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:42.631114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:42.644792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:42.645729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:45:42.646625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:42.647155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad86d0-9da3-4ab5-93f9-7a7530367f26 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.650586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 257/494] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:42.651432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.663057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.682121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.682799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.683034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.683468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.694240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:42.699132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:42.700675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 238/495] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:42.701458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.751506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.768669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0271c-4a2e-4b9a-a76b-ed1ea9ea9a83 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.805540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.806153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.806426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.806696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.807185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275b5a9-e03f-4f69-92c8-7ee94ec9a3ac None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.807360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:42.807649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:42.809131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:42.821724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 258/496] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:42.821724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.850642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c729-adf2-4280-935c-534ef348967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.851360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c729-adf2-4280-935c-534ef348967b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.851604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c729-adf2-4280-935c-534ef348967b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.851894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c729-adf2-4280-935c-534ef348967b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.863834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552c729-adf2-4280-935c-534ef348967b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-0552c729-adf2-4280-935c-534ef348967b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:42.870073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:42.870913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:42.872315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:42.873127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 239/497] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:42.873936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c729-adf2-4280-935c-534ef348967b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:42.889721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:42.928109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7263ed-1883-4757-a10b-cd1a97ade242 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.965917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:42.966616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:42.966889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:42.967152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:42.967919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:42.968218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:42.969681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:42.989076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c729-adf2-4280-935c-534ef348967b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:42.997424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.012993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 259/498] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:43.012993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.032012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.032764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.033105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.033451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.034115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:43.034410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.035823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.044421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 240/499] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:43.045535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.109782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c27e3d-fcde-45bc-a0f9-009bc20c9d38 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.135059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.146460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.147102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.147373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.147636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.153100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13be3ae-e4b9-4120-94dc-49a86cd6a270 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.158548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.160039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:43.175026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:43.176087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:43.181971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:43.181971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.181971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:43.181971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 260/500] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:43.181971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.187352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9121370-cdc4-470d-8515-40850ccd6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.188003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121370-cdc4-470d-8515-40850ccd6814 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.188280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121370-cdc4-470d-8515-40850ccd6814 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.188551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9121370-cdc4-470d-8515-40850ccd6814 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.189210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9121370-cdc4-470d-8515-40850ccd6814 None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:43.189509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9121370-cdc4-470d-8515-40850ccd6814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.190886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9121370-cdc4-470d-8515-40850ccd6814 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.198988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 241/501] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:43.200276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db6929-a57b-4d2c-a7ba-84e7435996df None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.200553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db6929-a57b-4d2c-a7ba-84e7435996df None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.200821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db6929-a57b-4d2c-a7ba-84e7435996df None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.202025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 242/502] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:43.202698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db6929-a57b-4d2c-a7ba-84e7435996df None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.233709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.283519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614c2db-2956-4f6d-b230-5acfdb422b1a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.303321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db6929-a57b-4d2c-a7ba-84e7435996df None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.317413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.318021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.318296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.318560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.337619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.338251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.338562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.338825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.349390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.350859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.364229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:43.366728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:43.367795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:43.368828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:43.368828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.368828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:43.368828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 243/503] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:43.369077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.390090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.391493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.454752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.475454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911266ef-1e6c-4ccf-b287-f085d29ff7b8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.489541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 261/504] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:43.490438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.509927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829c79b-4aa4-443d-9c40-4833c9e0ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.510541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829c79b-4aa4-443d-9c40-4833c9e0ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.510791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829c79b-4aa4-443d-9c40-4833c9e0ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.511055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829c79b-4aa4-443d-9c40-4833c9e0ddb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.511730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829c79b-4aa4-443d-9c40-4833c9e0ddb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:43.512050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829c79b-4aa4-443d-9c40-4833c9e0ddb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.513544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829c79b-4aa4-443d-9c40-4833c9e0ddb8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.525213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 244/505] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:43.526329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5346dc-7fec-495a-94f6-07978c9ea12e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.526638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5346dc-7fec-495a-94f6-07978c9ea12e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.526905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5346dc-7fec-495a-94f6-07978c9ea12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.544615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ef5346dc-7fec-495a-94f6-07978c9ea12e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:43.546026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ef5346dc-7fec-495a-94f6-07978c9ea12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:43.568691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.590812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a5093-d0dd-458b-a3f3-d4a62302936e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.614250 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 245/506] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:43.615079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5346dc-7fec-495a-94f6-07978c9ea12e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.625386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.626130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.626499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.626770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.637041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.638503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:43.654106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:43.659614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:43.660735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:43.660735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.660735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:43.660735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 262/507] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:43.660735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.691315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.722210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5346dc-7fec-495a-94f6-07978c9ea12e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.757413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.758151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.758544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.758901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.758996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672be5bf-8eda-4520-8d63-2d00f7e26b1b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.759653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:43.759974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.761361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.777057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 246/508] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:43.778011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.788317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.795949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.796690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.796962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.797341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.809071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.810581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:43.825639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:43.826583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:43.827411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:43.827411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:43.827411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:43.827411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 263/509] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:43.827622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.883863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb73d-69b2-410b-9e86-fd420021b6e8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.912664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:43.917934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.918809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.919087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.919355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.926909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.928108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bae369-3d21-470a-a964-3f76e7a812d1 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:43.928532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:43.941177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:43.942067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:43.942929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 247/510] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:43.943477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:43.968793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:43.969843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:43.970317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:43.970677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:43.971496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:43.971900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:43.973291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:43.985615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 264/511] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:43.986727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.030742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.046167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fa0df-f2fa-49d4-a920-ffda2cc09a6b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.079079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.079725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.080016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.080282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.086942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af134dc-763e-411b-ab6b-a0fd37b9c173 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.087580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.089071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:44.100163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:44.101089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:44.102023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 248/512] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:44.102575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.123645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.124282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.124553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.124810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.125443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:44.125733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.127095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.140642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 265/513] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:44.141805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.157619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.205616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744f108-e7b2-4c08-b2a7-109456158f12 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.238822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.239460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.239732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.240022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.247250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d316e-4e81-4a69-94e5-100e217ffbbb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.249603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.250591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.252071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:44.266552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:44.267537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:44.268401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:44.268401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:44.268401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:44.268401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 249/514] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:44.268401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.285179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.285786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.286060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.286326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.287051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:44.287347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.288861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.306856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 266/515] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:44.307668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.372241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2d1fc-a1d0-4933-ba6d-a462ec33a737 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.374677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.408864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.409493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.409768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.410033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.410890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77571a6d-1157-413d-8c6e-abfb180ad565 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.416879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.418403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:44.430431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:44.431339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 250/516] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:44.432259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.454013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.454627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.454903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.455170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.456001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:44.456228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.457692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.475117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 267/517] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:44.475945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.497050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.536518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a143-eefd-48de-b907-f6bc1143c8c5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.569512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.570132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.570402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.570662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.576157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9e67-6684-439d-92df-2fe37c9e8221 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.577651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.579983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:44.593162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:44.594017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:44.594845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 251/518] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:44.595330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.615769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.616376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.616674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.616937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.617574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:44.617874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.619252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.623093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.631246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 268/519] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:44.632062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.700680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf04ce-0e3b-438e-b6db-7e072208a35a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.709591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.731966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be919351-e563-4078-8f12-95fe6b8f904e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.734701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.735299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.735574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.736220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.771473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.772090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.772365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.772630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.773350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:44.773650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.775097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.791966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 269/520] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:44.792751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.804023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:44.805470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:44.829778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.890912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6f38c-167a-454f-be53-8ad89644977b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:44.903474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 252/521] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:44.904334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:44.929848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:44.930457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:44.930729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:44.930997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:44.935159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:44.999185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.000617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.006676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e73f68-81fc-4a41-81ce-3ebb23bb776a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.030180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.041064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.041669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.041925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.042188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.042863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:45.043217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.044661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.062774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 253/522] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:45.063569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.105657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 270/523] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:45.106316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.140308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.165737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24f844-293e-479f-8db9-9913799272c2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.201299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.201915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.202190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.202456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.203112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.204584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.205400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0b2ce-47a4-4a05-9879-1c1e3f809569 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.226854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 254/524] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:45:45 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:45:45.227901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.241797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.242423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.242692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.242950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.292158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.323217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.324985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.361171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35afc8-0eec-40f3-9627-837babef197e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.363599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.398941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.399627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.399929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.400198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.413790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.415579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:45.431561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:45.432776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:45.433676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:45.433676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:45.433676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:45.433676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 255/525] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:45.434036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.441357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 271/526] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:45.442145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.546162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.548334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a319a-fd14-4761-b525-76cebdd56186 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.556976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6d8f-d878-4527-bafd-67b6e8ffcd3c None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.585379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.586020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.586299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.586552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.589559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.595516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.596194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.596473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.596990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.597466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=ac2cabfcf8224f70a3129dc308e67b4f) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:45.597768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.599008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.599206 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.600483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.605129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 256/527] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/role_assignments?user.id=ac2cabfcf8224f70a3129dc308e67b4f&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:45.613293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:45.617186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:45.618253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:45.619123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:45.619123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:45.619123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:45.619123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 272/528] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:45.619918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.744209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5ed1c-b33e-42f5-910a-71af19a6bdfd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.744675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b398e-0009-4b1f-a10e-f9979eec70bc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.783691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.784478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.784758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.785026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.787479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.788605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.789077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.789560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.790439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:45.790923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.792614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.802610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.804035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.806278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 257/529] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:45.807594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:45.820475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:45.821573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:45.822495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:45.822495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:45.822495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:45.822495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 273/530] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:45.822495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.830666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.876142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:45.924282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcacd-c4bd-4743-ad20-dbbef6b9c0b4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.942493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bcb58-73b6-4771-a08c-4d82ee8ccab9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:45.961635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.962589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.962958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.963731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:45.965095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:45.965095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:45.966641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:45.986835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 258/531] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:45.987999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:45.996181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:45.997179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:45.997598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:45.997995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.007923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.010052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:46.026661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:46.027733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:46.028657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:46.030844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 274/532] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:46.032037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.082540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:46.110556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3fa73-ac9c-49be-8d8f-4f48573f57c0 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.156449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:46.160380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.161046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb02c7e-052d-4c6b-91b2-958c7763ac3a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.161240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.161608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.161973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.162750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:46.163145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.166735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.182955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 259/533] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:46.188567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.203487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.204393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.204859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.205307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.212768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.214432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:46.226423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:46.227263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:46.228155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:46.230435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 275/534] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:46.231367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.306701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69704348-933a-48d8-a3af-605f10cef3ad None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.347269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.348309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.348751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.349178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.350509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:46.351247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.352913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.357093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:46.366281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ccce-6d63-401c-ad59-7ffb07d7a77a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.370555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 260/535] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:46.371758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.408220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.409286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.409792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.410241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.417471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.419413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:46.439998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:46.440881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:46.441707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:46.444058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 276/536] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:46.445087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.468338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:46.501263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde7ad2-5556-44f7-a734-a630270e9f25 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.542661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.543494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.544082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.544082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.544658 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:46.544957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.546382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.560141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 261/537] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:46.561197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.572195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70442b49-8d7f-4ef3-b519-4b8a4f553884 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.610451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.611492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.611792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.612058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.612988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=faee06d60a484eebb6a9fb31ce0878d5) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:46.613294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.615003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.622656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 277/538] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/role_assignments?user.id=faee06d60a484eebb6a9fb31ce0878d5&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:46.623838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.634826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:46.694221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948362-2047-4841-961e-34f8c22017b7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.715779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:46.738307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.739300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.739835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.740298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.741223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:46.741726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.743396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.758974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 262/539] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:46.765527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:46.770611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e39f5d-63e9-4287-8009-d2e0c5732193 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.879435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f405987-77f0-43a9-8c35-b20962a600ed None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:46.884414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb866826-580d-4918-9156-228cbf3aa977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.885045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866826-580d-4918-9156-228cbf3aa977 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.885327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866826-580d-4918-9156-228cbf3aa977 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.885598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb866826-580d-4918-9156-228cbf3aa977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.886340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb866826-580d-4918-9156-228cbf3aa977 None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=6083dd9ef4544aa6a596915f5b899b8c) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:46.886734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb866826-580d-4918-9156-228cbf3aa977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.888281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb866826-580d-4918-9156-228cbf3aa977 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.900755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:46.905219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 278/540] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/role_assignments?user.id=6083dd9ef4544aa6a596915f5b899b8c&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:46.931226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa69e9-01c0-424e-be38-65fc8d03dcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:46.932650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa69e9-01c0-424e-be38-65fc8d03dcef None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:46.933130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa69e9-01c0-424e-be38-65fc8d03dcef None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:46.933633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa69e9-01c0-424e-be38-65fc8d03dcef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:46.934626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa69e9-01c0-424e-be38-65fc8d03dcef None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=3a022b80e5eb460b92e4e99728b22770) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:46.935154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa69e9-01c0-424e-be38-65fc8d03dcef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:46.936895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa69e9-01c0-424e-be38-65fc8d03dcef None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:46.950449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 263/541] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:46 2022] GET /identity/v3/role_assignments?user.id=3a022b80e5eb460b92e4e99728b22770&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:47.638204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f556d5-3989-4d90-b21e-c5f1805c10f0 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:47.638753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f556d5-3989-4d90-b21e-c5f1805c10f0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:47.638753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f556d5-3989-4d90-b21e-c5f1805c10f0 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:47.640366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 279/542] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:47.645948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e10f7a-ff4c-4ca0-9f70-9397edcb5d25 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:47.646231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e10f7a-ff4c-4ca0-9f70-9397edcb5d25 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:47.646498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e10f7a-ff4c-4ca0-9f70-9397edcb5d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:47.669039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e0e10f7a-ff4c-4ca0-9f70-9397edcb5d25 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:47.670239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e0e10f7a-ff4c-4ca0-9f70-9397edcb5d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:47.757545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 264/543] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:48.149033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f556d5-3989-4d90-b21e-c5f1805c10f0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:48.211416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f55bd-eeb7-4479-8786-ac45c4b5cb93 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:48.211974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f55bd-eeb7-4479-8786-ac45c4b5cb93 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:48.211974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f55bd-eeb7-4479-8786-ac45c4b5cb93 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:48.213588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 265/544] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:48.220109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911f7d-b38d-4b0e-9988-c48dc048e0d1 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:48.220388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911f7d-b38d-4b0e-9988-c48dc048e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:48.220660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911f7d-b38d-4b0e-9988-c48dc048e0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:48.251849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2f911f7d-b38d-4b0e-9988-c48dc048e0d1 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:48.253503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2f911f7d-b38d-4b0e-9988-c48dc048e0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:48.271658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f556d5-3989-4d90-b21e-c5f1805c10f0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:48.337191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:48.338202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:48.338671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:48.339126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:48.360029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:48.368769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:48.369658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:48.370457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:48.381359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 280/545] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:48.386451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:48.393033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 266/546] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:48.398899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:48.497611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f1961-438f-434c-8b70-341dcc61fddc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:48.547025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:48.547640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:48.547938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:48.548201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:48.548860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:48.549153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:48.550634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:48.563160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 281/547] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:48.568581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f911f7d-b38d-4b0e-9988-c48dc048e0d1 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:48.636348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:48.700576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f911f7d-b38d-4b0e-9988-c48dc048e0d1 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:48.721187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:48.741633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:48.742279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:48.742553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:48.742824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:48.764820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:48.766293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:48.803126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:48.804100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:48.804946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:48.804946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:48.804946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:48.804946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 267/548] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:48.811488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:48.856598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:48.914109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67c308-7d5d-4313-9ba0-ea38cdbff6ec None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:48.974283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:48.980428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:48.981155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:48.981430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:48.981698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:48.991758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766662e9-c75f-4f4d-9e8c-76882b48e966 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.004216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:49.011230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:49.012750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:49.013716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:49.017264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 282/549] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:49.023833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:49.053356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.053980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.054272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.054527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.055169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:49.055466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.059711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.082653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 268/550] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:49.092773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:49.158741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943d9e-ed64-4b15-8ca7-b61a1607c1ec None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.209872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:49.228526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.229076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.229359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.229633 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.230391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:49.230695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.232137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.253793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 283/551] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:49.258942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:49.303807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d91f-5f4f-4519-962c-4b1d61bf2f48 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.345867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d59de-0c30-4acf-8bb0-ee6f0d6c6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.346966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d59de-0c30-4acf-8bb0-ee6f0d6c6d28 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.347438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d59de-0c30-4acf-8bb0-ee6f0d6c6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.347931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d59de-0c30-4acf-8bb0-ee6f0d6c6d28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.356994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d59de-0c30-4acf-8bb0-ee6f0d6c6d28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.358912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d59de-0c30-4acf-8bb0-ee6f0d6c6d28 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-991d59de-0c30-4acf-8bb0-ee6f0d6c6d28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:49.372786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:49.373871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:49.374807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 269/552] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:45:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:49.375379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb52b-41a4-4d66-aba8-9bef13195717 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.375379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb52b-41a4-4d66-aba8-9bef13195717 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.376345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb52b-41a4-4d66-aba8-9bef13195717 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.381497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 270/553] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:49.384584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb52b-41a4-4d66-aba8-9bef13195717 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:49.404833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecea1e-0ad7-441b-bf50-dcafa48c72d0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.405670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:49.446442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baa5ac-1a7c-4c58-b79e-2aacd8018ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.447092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa5ac-1a7c-4c58-b79e-2aacd8018ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.447382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa5ac-1a7c-4c58-b79e-2aacd8018ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.447634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa5ac-1a7c-4c58-b79e-2aacd8018ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.458513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa5ac-1a7c-4c58-b79e-2aacd8018ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.460035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa5ac-1a7c-4c58-b79e-2aacd8018ca0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a6baa5ac-1a7c-4c58-b79e-2aacd8018ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:49.474292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:49.475325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:49.476225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:49.476225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:49.476225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:49.480039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 284/554] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:49.481375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4e5a-27ad-432a-99f6-ec57e78191e7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.481655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4e5a-27ad-432a-99f6-ec57e78191e7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.481919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4e5a-27ad-432a-99f6-ec57e78191e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.501079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2cef4e5a-27ad-432a-99f6-ec57e78191e7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:49.502264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2cef4e5a-27ad-432a-99f6-ec57e78191e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:49.503134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb52b-41a4-4d66-aba8-9bef13195717 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.541848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d547a3c-a9f0-421a-9573-9b7126a09175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.542462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d547a3c-a9f0-421a-9573-9b7126a09175 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.542808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d547a3c-a9f0-421a-9573-9b7126a09175 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.543046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d547a3c-a9f0-421a-9573-9b7126a09175 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.543787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d547a3c-a9f0-421a-9573-9b7126a09175 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:49.544092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d547a3c-a9f0-421a-9573-9b7126a09175 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.544748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:49.545963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d547a3c-a9f0-421a-9573-9b7126a09175 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.573474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 285/555] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:49.574965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1897f3-92a1-49dc-a9f0-0e1c8c4c01df None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.575342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1897f3-92a1-49dc-a9f0-0e1c8c4c01df None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.575731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1897f3-92a1-49dc-a9f0-0e1c8c4c01df None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.581179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 286/556] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:49.581179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1897f3-92a1-49dc-a9f0-0e1c8c4c01df None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:49.594140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 271/557] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Sep 15 12:45:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:49.595523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a123-de48-437e-90d8-3ed652ba4c2c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.595945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a123-de48-437e-90d8-3ed652ba4c2c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.596310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a123-de48-437e-90d8-3ed652ba4c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.615690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3f37a123-de48-437e-90d8-3ed652ba4c2c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:49.617074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3f37a123-de48-437e-90d8-3ed652ba4c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:49.685927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:49.696717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 272/558] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:49.696717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a123-de48-437e-90d8-3ed652ba4c2c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:49.705810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1897f3-92a1-49dc-a9f0-0e1c8c4c01df None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.764552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ebc4c-4d93-4937-acde-31bbdb20da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.765167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ebc4c-4d93-4937-acde-31bbdb20da6c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.765345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ebc4c-4d93-4937-acde-31bbdb20da6c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.765612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ebc4c-4d93-4937-acde-31bbdb20da6c None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.766259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ebc4c-4d93-4937-acde-31bbdb20da6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:49.766560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ebc4c-4d93-4937-acde-31bbdb20da6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.767972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ebc4c-4d93-4937-acde-31bbdb20da6c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.782032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 287/559] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:49.783323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97359c3b-4165-4509-8d78-d1715a926a35 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.783606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97359c3b-4165-4509-8d78-d1715a926a35 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.784147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97359c3b-4165-4509-8d78-d1715a926a35 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.786509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 288/560] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:49.787202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97359c3b-4165-4509-8d78-d1715a926a35 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:49.798154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a123-de48-437e-90d8-3ed652ba4c2c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.827907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:49.836295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.836911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.837187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.837457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.902964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97359c3b-4165-4509-8d78-d1715a926a35 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:49.908630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:49.910991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.912722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.942405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403828-17d4-4c18-a88c-a11d4f690cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:49.943047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403828-17d4-4c18-a88c-a11d4f690cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.943314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403828-17d4-4c18-a88c-a11d4f690cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.943580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403828-17d4-4c18-a88c-a11d4f690cb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.951141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403828-17d4-4c18-a88c-a11d4f690cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:49.952768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403828-17d4-4c18-a88c-a11d4f690cb8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-48403828-17d4-4c18-a88c-a11d4f690cb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:49.966202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:49.967370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:45:49.968578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:49.969718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 289/561] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:49.970759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ed17-3a21-43ee-a97b-e180e1dff891 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:49.971102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ed17-3a21-43ee-a97b-e180e1dff891 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:49.971423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88ed17-3a21-43ee-a97b-e180e1dff891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:49.992200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-fb88ed17-3a21-43ee-a97b-e180e1dff891 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:49.993377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fb88ed17-3a21-43ee-a97b-e180e1dff891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:50.026047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 273/562] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:50.026796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.071244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 290/563] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:50.072143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ed17-3a21-43ee-a97b-e180e1dff891 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.097101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.128252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.130925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d3f7-f729-4aa0-af3d-59163f9927b3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.165038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.165671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.165944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.166445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.175337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88ed17-3a21-43ee-a97b-e180e1dff891 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.176519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:50.181569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:50.182471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:50.183367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 274/564] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:50.184196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.219831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.220812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.221272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.221535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.222271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:50.222566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.224044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.246352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 291/565] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:50.247312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.296491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c55cd-3a3c-4996-8ed1-f352e10c9ce2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.328228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.334347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.335109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.335455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.335745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.346204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:50.346908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6e20-24d4-48af-8b36-b657211943cc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:50.351033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:50.352167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 275/566] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:50.353354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.375521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.385567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.386199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.386552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.386813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.396539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.397979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:50.412526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:50.413464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:50.414345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:50.414345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:50.414345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:50.414345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 292/567] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:50.414575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.456815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edd107-df95-4704-9b0f-d3889fa915da None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.490636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.491241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.491516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.491801 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.492458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:50.492750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.494120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.501975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 276/568] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:50.502912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.518234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bea7a-447e-409e-9a73-f9179f9ef351 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.550704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.551279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.551540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.551834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.553677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.562430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.563907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:50.577813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:50.583587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:50.584673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:50.584673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:50.584673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:50.584673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 293/569] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:50.584673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.585614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.602484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76201d9-9812-4387-a0e4-5f6b572b86bd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.637317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.637931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.638206 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.638475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.650266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:50.655125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:50.656140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:50.656979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 277/570] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:50.657669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.688245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacefe4-fbdb-44e2-b80c-6e31f1b0cbe6 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.722560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.723166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.723439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.723715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.724386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:50.724679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.726127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.734555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 294/571] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:50.735333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.758150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722eab-0572-4aad-b33b-92bcc3427d06 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.789058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.793706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.794322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.794598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.794890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.795517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:50.795852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.797227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.808598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 278/572] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:50.809006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.815061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:50.842231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf85a05-a9de-4323-8f60-29c57f96a939 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.875226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.875885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.876161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.876428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.887802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.889292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:50.903549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:50.904591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:50.905493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:50.905493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:50.905493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:50.905493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 295/573] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:50.905740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:50.914345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef711c-5076-499d-85d3-51fd1194be6d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:50.947380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:50.948021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:50.948292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:50.948551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:50.949678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:50.949969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:50.951316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:50.962661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 279/574] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:50.963614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.008057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.011068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8419d38-08fc-4f56-92cd-a6ebb16bd758 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.030921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.046313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.046923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.047194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.047458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.048177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:51.048483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.049835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.057582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 296/575] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:51.058741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.070007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288131-fd9e-4cde-ad09-7d22a7a30817 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.104248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.104860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.105172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.105435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.115635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.117102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:51.131510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:51.132511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:51.133424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:51.133424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:51.133424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:51.133424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 280/576] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:51.133424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.163604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e1fb0-73c6-401a-9d41-b55fa95568b1 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.196302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.196928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.197198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.197458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.204046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.205490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:51.216779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:51.217863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 297/577] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:51.218809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.235369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2fb0-c431-4369-a525-e14d054fd726 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.243348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.250909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.271054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.271673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.271982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.272245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.272884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:51.273185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.274564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.287140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 281/578] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:51.287946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.321603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab192f-8d28-47b9-a702-1d590365ba4b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.354859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.355589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.356044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.356316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.363591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.365106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:51.376745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:51.377822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 298/579] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:51.378713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.392221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960d08-661c-4160-bf30-629d566613bd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.428080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.428873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.429420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.429693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.441105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.442563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:51.456697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:51.457710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:51.458631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:51.458631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:51.458631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:51.458631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 282/580] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:51.458631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.466625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.486503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.486734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e539ece-7585-4f7f-8e47-ac5c38b3aca4 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.520887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.521490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.521759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.522041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.522667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:51.522959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.524380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.535704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 299/581] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:51.536491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.565441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5228c8-c940-4bcf-9101-f0bcc8971de0 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.600440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.600970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.601243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.601510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.602189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:51.602484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.603935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.615981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 283/582] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:51.616623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.640660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873c797-ca4c-476a-9584-7add662e4ea0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.675467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb4393-4876-4720-af9b-394769a235df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.676118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb4393-4876-4720-af9b-394769a235df None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.676402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb4393-4876-4720-af9b-394769a235df None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.676662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb4393-4876-4720-af9b-394769a235df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.683865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb4393-4876-4720-af9b-394769a235df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.685316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb4393-4876-4720-af9b-394769a235df None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-11bb4393-4876-4720-af9b-394769a235df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:51.696991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:51.697934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 300/583] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:51.698912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb4393-4876-4720-af9b-394769a235df None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.701468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.706639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.722640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb427b-97ba-4f54-9ad1-e0429bdf44bb None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.756509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.757123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.757399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.757665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.758351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:51.758653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.760130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.771680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 284/584] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:51.772741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.800104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb4393-4876-4720-af9b-394769a235df None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.833105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.833719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.833996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.834259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.834890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:51.835185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.836586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.848231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 301/585] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:51.849237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.874629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1894ed-ab0c-4650-9a3a-3d19d5443330 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.909261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.909688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.909888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.910160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.910518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.918191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.919589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:51.930947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:51.932073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 285/586] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:51.933050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:51.942598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:51.950115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd2f9d-736e-4d32-b8a8-90b3f50e0ec5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:51.982998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:51.983626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:51.983922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:51.984190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:51.984910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=75b6057e2fd7438cb3fa2a0ec2933fcc) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:51.985208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:51.986994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:51.992469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 302/587] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/role_assignments?user.id=75b6057e2fd7438cb3fa2a0ec2933fcc&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:51.993207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.044080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc821a6-bd4c-4078-9272-b99919c87947 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.083140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.083794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.084220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.084468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.085210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:52.085514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.087114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.113394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 286/588] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Sep 15 12:45:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:52.113629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a98059-bc69-469d-9378-bf4b0abab00d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.113715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.138780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:52.148225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.148907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.149187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.149460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/ac2cabfcf8224f70a3129dc308e67b4f/roles/18adaf361b7749e69eabe75f61459b46` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.166512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=ac2cabfcf8224f70a3129dc308e67b4f, role_id=18adaf361b7749e69eabe75f61459b46)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.168712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.191736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 303/589] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:51 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/ac2cabfcf8224f70a3129dc308e67b4f/roles/18adaf361b7749e69eabe75f61459b46 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:52.191736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.198103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:52.248653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af851d-e522-4ab9-88c2-59ca96ea7ea4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.291671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.292978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.294104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.294573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.303416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.305295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.313414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c890e59-7d4f-4632-aef0-2a1137cb1ee3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:52.320535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:52.321523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:45:52.322483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:52.326062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 287/590] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:52.327260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.358498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918958a-ee7a-4249-9232-745573877828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.359123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918958a-ee7a-4249-9232-745573877828 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.359394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918958a-ee7a-4249-9232-745573877828 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.359729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918958a-ee7a-4249-9232-745573877828 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.360762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918958a-ee7a-4249-9232-745573877828 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:52.361059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918958a-ee7a-4249-9232-745573877828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.362621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918958a-ee7a-4249-9232-745573877828 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.382382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 304/591] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:52.383280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918958a-ee7a-4249-9232-745573877828 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.425902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:52.460883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44434d-40f5-4d50-a2f8-b7c44b44d7e7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.487066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:52.498859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.499496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.499792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.500063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.513717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.516047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.518642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918958a-ee7a-4249-9232-745573877828 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:52.531082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:52.532257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:52.533985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:52.533985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:52.533985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:52.535778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 288/592] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:52.536612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.560347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.560956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.561227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.561489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.562215 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:52.562506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.563999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.587280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 305/593] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:52.588147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.650543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f056ebd-2a1f-4626-a5d2-f5e360b41280 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.687244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:52.687433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.688191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.688191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.688439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.698135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888103a7-de90-45ec-abb9-78878411aec8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.700674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.702970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:52.720510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:52.721708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:52.722720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:52.722720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:52.722720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:52.722720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 289/594] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:52.722720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.742958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.743663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.744496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.744829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.745615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:52.746510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.748195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.764279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 306/595] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:52.764649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:52.766516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.855179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dac51-c57b-42c8-9701-9ea9e94511f8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.897530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.898402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.898773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.899327 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.902972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf218-45b4-4c20-8cf7-0fd9a675c1cc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:52.910635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.912805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:52.929021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:52.930271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:52.931379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:52.931379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:52.931379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:52.937408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 290/596] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:52.938405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.949917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:52.950786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:52.951219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:52.952103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:52.952892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:52.953724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:52.955549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:52.975303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 307/597] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:52.976686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:52.996818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:53.048680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:53.077720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6288b96-878a-43c0-877b-a3e8bf51e653 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.100013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568048dc-b0f3-4f16-a29e-5bd98e8be248 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.124235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.125626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.126387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.126865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.136046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.136965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.137494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.137775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.138037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.138696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:53.138987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.140468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:53.155759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:53.156752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:53.157693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:53.158706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 308/598] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:53.159468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.160324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 291/599] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:53.161293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.232797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:53.265111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd51ea-fb41-43ea-a9e5-4a7a6889aebf None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.300544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.301174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.301445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.301708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.302422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f5b2-ede9-4bb2-884f-074be8edcb59 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.308617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.310321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:53.322296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:53.323185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:53.324191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 309/600] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:53.325149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.348816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.350091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.350865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.351744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.362812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.364548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.367849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:53.381961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:53.383046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:53.384036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:53.387773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 292/601] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:53.388795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.449112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee177a22-94e7-4f9d-9af3-7ba51e005364 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.481052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:53.486422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.486972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.487243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.487503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.488291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:53.489943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.490136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.514837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 310/602] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:53.515780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.521348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22af55c-e7be-472b-b1a4-9d320f468267 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.565418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.566844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.567746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.568231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.569366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:53.569879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.572544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.588829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 293/603] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:53.589727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.640638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce05b2-f97d-418a-8795-839495dd16e7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.666207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:53.684284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.684900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.685170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.685432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.686115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:53.686408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.687863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.707764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 311/604] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:53.708907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.723919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37634b8-8adf-4b48-8ef8-3414a1e1c53d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.768641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.769254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.769528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.769794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/faee06d60a484eebb6a9fb31ce0878d5/roles/18adaf361b7749e69eabe75f61459b46` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.778845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:53.792949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=faee06d60a484eebb6a9fb31ce0878d5, role_id=18adaf361b7749e69eabe75f61459b46)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.795935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.813345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 294/605] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:53 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/faee06d60a484eebb6a9fb31ce0878d5/roles/18adaf361b7749e69eabe75f61459b46 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:53.814500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:53.838547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb73c28-219c-450f-8525-a310fd775b5a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:53.876691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330535d-8a44-45e4-b282-5d6ced04dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:53.877483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330535d-8a44-45e4-b282-5d6ced04dc1d None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:53.877763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330535d-8a44-45e4-b282-5d6ced04dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:53.878031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330535d-8a44-45e4-b282-5d6ced04dc1d None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/6083dd9ef4544aa6a596915f5b899b8c/roles/18adaf361b7749e69eabe75f61459b46` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:53.895084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330535d-8a44-45e4-b282-5d6ced04dc1d None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=6083dd9ef4544aa6a596915f5b899b8c, role_id=18adaf361b7749e69eabe75f61459b46)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:53.896667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330535d-8a44-45e4-b282-5d6ced04dc1d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:53.921009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 312/606] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:53 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/6083dd9ef4544aa6a596915f5b899b8c/roles/18adaf361b7749e69eabe75f61459b46 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:53.997258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9eb45-e421-4d66-abb5-56c9e0263c3e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:54.011419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:54.047406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515ffee-d290-4a82-9672-45c58b60ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:54.048053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515ffee-d290-4a82-9672-45c58b60ee7d None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:54.048328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515ffee-d290-4a82-9672-45c58b60ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:54.048596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515ffee-d290-4a82-9672-45c58b60ee7d None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/3a022b80e5eb460b92e4e99728b22770/roles/18adaf361b7749e69eabe75f61459b46` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:54.067884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515ffee-d290-4a82-9672-45c58b60ee7d None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=3a022b80e5eb460b92e4e99728b22770, role_id=18adaf361b7749e69eabe75f61459b46)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:54.069369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515ffee-d290-4a82-9672-45c58b60ee7d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:54.095104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 295/607] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:53 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/3a022b80e5eb460b92e4e99728b22770/roles/18adaf361b7749e69eabe75f61459b46 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:54.276662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cb3d-ca39-4480-83de-21629809c999 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:54.277034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cb3d-ca39-4480-83de-21629809c999 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:54.277426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cb3d-ca39-4480-83de-21629809c999 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:54.279071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 313/608] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:54.285018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d982e-4ee2-41a4-bf4e-1b550f2b6cb5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:54.285295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d982e-4ee2-41a4-bf4e-1b550f2b6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:54.285569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d982e-4ee2-41a4-bf4e-1b550f2b6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:54.304529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-749d982e-4ee2-41a4-bf4e-1b550f2b6cb5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:54.305639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-749d982e-4ee2-41a4-bf4e-1b550f2b6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:54.377063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 296/609] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:45:54.562468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c268bd-cd3f-4720-ae5f-db08945f6dfa None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:54.562649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c268bd-cd3f-4720-ae5f-db08945f6dfa None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:54.562915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c268bd-cd3f-4720-ae5f-db08945f6dfa None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:54.564588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 314/610] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:54.569839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36f734-0c69-42f2-a332-fd1c2a0b40f1 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:54.570304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36f734-0c69-42f2-a332-fd1c2a0b40f1 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:54.570388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36f734-0c69-42f2-a332-fd1c2a0b40f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:54.592728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4e36f734-0c69-42f2-a332-fd1c2a0b40f1 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:54.593987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4e36f734-0c69-42f2-a332-fd1c2a0b40f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:54.668758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 297/611] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:54.722378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c268bd-cd3f-4720-ae5f-db08945f6dfa None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:54.835238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c268bd-cd3f-4720-ae5f-db08945f6dfa None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:54.836766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:54.881734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:54.882381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:54.882654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:54.882922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:54.893996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:54.899010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:54.899965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:54.900810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 315/612] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:54.906667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36f734-0c69-42f2-a332-fd1c2a0b40f1 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:54.929557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:55.009872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36f734-0c69-42f2-a332-fd1c2a0b40f1 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.038518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.044605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.045280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.045556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.045823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.046527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:55.046829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:55.048246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:55.057740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 298/613] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:55.063594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.160103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:55.178387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9489f-a9ce-441a-94d1-fd0e33b03667 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.214360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.214999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.215410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.216225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.227443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:55.229227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:55.244796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:55.245828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:55.246688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:55.246688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:55.246688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:55.246688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 299/614] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:55.252978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.341844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd8305-96cb-4f42-9f28-fcd475e71165 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.390939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.391574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.391870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.392130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.404006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27258774-8b79-4796-bd4c-9bb45d3159da None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.431014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:55.436141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:55.437070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:55.437894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:55.441797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.441797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.441797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.441797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.442146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:55.442146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:55.448267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:55.448267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:55.448899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 316/615] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:55.456687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.460219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 300/616] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:55.466497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.533222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:55.603121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe34c-7148-4731-89e2-ad75a8384547 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.667558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208384-d396-413b-af98-1d0ebdb01f33 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.675971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.676622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.676902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.677169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.693069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:55.694457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:55.704820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.705726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.706189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.706666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.707649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:55.708167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:55.709742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:55.717239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:55.718204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:45:55.719147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:55.721676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 317/618] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:55.722397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 301/618] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:55.724789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.726706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.818969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:55.831690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6400da-f4da-4794-be99-f8fb833f30f3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.870179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:55.916443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.917070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.917402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.917672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.918416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:55.918720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:55.920213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:55.925708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdfd81-496d-41d9-ba77-6c1eecf20819 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:55.959490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 318/619] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:55.965169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:55.968016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:55.968819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:55.969104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:55.969368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:55.990873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:55.992678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:56.010288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:56.011468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:56.012974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:56.012974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:56.012974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:56.012974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 302/620] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:56.017902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:56.124509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a636061-b2dc-42ba-8338-9726c2de1e4a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:56.168222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:56.168864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.169135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.169399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.180293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:56.182162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.184550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91e93-b7b3-49d8-a735-cccb2e8b816a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:56.189596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:56.199356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:56.200848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:56.202080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:56.202080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:56.202080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:56.202253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:56.202338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 319/621] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:56.208953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:56.250230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:56.250773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.251047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.251313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.251987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:56.252285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:56.253660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.278312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 303/622] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:56.283897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:56.338164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb55c8-d0c9-4d9a-8db7-0885a4a5f542 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:56.374962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:56.375588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.375914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.376182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.376827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:56.377126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:56.380651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.411919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 320/623] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:45:56.417147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:56.516480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d54bc-aca0-4e1f-a00b-da36652f2b2f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:56.528044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:56.586311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef39729-69a9-4d22-a89f-b0a26a96d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:56.588280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39729-69a9-4d22-a89f-b0a26a96d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.590081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39729-69a9-4d22-a89f-b0a26a96d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.590699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef39729-69a9-4d22-a89f-b0a26a96d1e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.605170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef39729-69a9-4d22-a89f-b0a26a96d1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:56.610569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef39729-69a9-4d22-a89f-b0a26a96d1e5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.613051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eab7b-d4d5-4b0c-8fb2-542c1aed638b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-5ef39729-69a9-4d22-a89f-b0a26a96d1e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:56.623226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:56.624458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:45:56.625656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:56.627407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 304/624] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:45:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:56.628942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d911-33e1-4299-875b-80404d3efc50 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.629133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d911-33e1-4299-875b-80404d3efc50 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.629510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d911-33e1-4299-875b-80404d3efc50 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.634995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 305/625] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:56.634995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208d911-33e1-4299-875b-80404d3efc50 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:56.664301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:56.665470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196defa-32f0-49df-bd15-14baa0ac2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:56.666349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196defa-32f0-49df-bd15-14baa0ac2d89 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.667594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196defa-32f0-49df-bd15-14baa0ac2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.668706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196defa-32f0-49df-bd15-14baa0ac2d89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.678888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196defa-32f0-49df-bd15-14baa0ac2d89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:56.681408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196defa-32f0-49df-bd15-14baa0ac2d89 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-4196defa-32f0-49df-bd15-14baa0ac2d89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:56.699650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:56.700671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 321/626] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:45:56.702455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667e6b8-9a2d-4a40-b7c4-8786100abba2 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.703031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667e6b8-9a2d-4a40-b7c4-8786100abba2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.703031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667e6b8-9a2d-4a40-b7c4-8786100abba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.723008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c667e6b8-9a2d-4a40-b7c4-8786100abba2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:56.724222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c667e6b8-9a2d-4a40-b7c4-8786100abba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:56.769674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208d911-33e1-4299-875b-80404d3efc50 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:56.795322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 322/627] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:56.796634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd255-393a-4026-9ea1-fa6830623006 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.796921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd255-393a-4026-9ea1-fa6830623006 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.797187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd255-393a-4026-9ea1-fa6830623006 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.802545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 323/628] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:56.802545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bd255-393a-4026-9ea1-fa6830623006 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:56.810821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad7abf-483e-4115-9f2c-2bf8ee5e2314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:56.811910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7abf-483e-4115-9f2c-2bf8ee5e2314 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.812320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7abf-483e-4115-9f2c-2bf8ee5e2314 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.812587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad7abf-483e-4115-9f2c-2bf8ee5e2314 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.813322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad7abf-483e-4115-9f2c-2bf8ee5e2314 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:56.813622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad7abf-483e-4115-9f2c-2bf8ee5e2314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:56.815054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad7abf-483e-4115-9f2c-2bf8ee5e2314 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.841375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 306/629] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:45:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:56.841375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492eb0f-04e9-4fd7-ab17-4823be0d1f5f None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.841375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492eb0f-04e9-4fd7-ab17-4823be0d1f5f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.841375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492eb0f-04e9-4fd7-ab17-4823be0d1f5f None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.841375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 307/630] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:56.842348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cdf01-8441-4e83-ab39-3efe8a880ee8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.842348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cdf01-8441-4e83-ab39-3efe8a880ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.842528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cdf01-8441-4e83-ab39-3efe8a880ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.848754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:56.861774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-957cdf01-8441-4e83-ab39-3efe8a880ee8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:56.862985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-957cdf01-8441-4e83-ab39-3efe8a880ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:56.908187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bd255-393a-4026-9ea1-fa6830623006 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:56.931772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 308/631] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:56.939874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cdf01-8441-4e83-ab39-3efe8a880ee8 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:56.952552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3835e4-3dbc-4f02-9ee8-9d723c1ca89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:56.953221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:56.954201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3835e4-3dbc-4f02-9ee8-9d723c1ca89e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.954593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3835e4-3dbc-4f02-9ee8-9d723c1ca89e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.954889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3835e4-3dbc-4f02-9ee8-9d723c1ca89e None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.955591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3835e4-3dbc-4f02-9ee8-9d723c1ca89e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:56.955931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3835e4-3dbc-4f02-9ee8-9d723c1ca89e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:56.957407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3835e4-3dbc-4f02-9ee8-9d723c1ca89e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:56.971068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 324/632] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:56.972523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4b50-82a7-42e3-b50b-66151e425773 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:56.972817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4b50-82a7-42e3-b50b-66151e425773 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:56.973077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c4b50-82a7-42e3-b50b-66151e425773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:56.992327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-319c4b50-82a7-42e3-b50b-66151e425773 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:45:56.993665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-319c4b50-82a7-42e3-b50b-66151e425773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:45:57.061879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cdf01-8441-4e83-ab39-3efe8a880ee8 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.075573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 325/633] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:45:57.075573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c4b50-82a7-42e3-b50b-66151e425773 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.101285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.101963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.102242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.102511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.124924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.183045 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:57.184389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:57.200383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.226901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c4b50-82a7-42e3-b50b-66151e425773 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.267722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.268387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.268670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.268937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/75b6057e2fd7438cb3fa2a0ec2933fcc/roles/18adaf361b7749e69eabe75f61459b46` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.284008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=75b6057e2fd7438cb3fa2a0ec2933fcc, role_id=18adaf361b7749e69eabe75f61459b46)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:57.285585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:57.308019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 309/634] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:57.308019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.308319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 326/635] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:45:57 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/75b6057e2fd7438cb3fa2a0ec2933fcc/roles/18adaf361b7749e69eabe75f61459b46 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:45:57.308319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.419520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.425328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067bdab-fc76-4f16-868a-ed7b2de6d21c None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.442456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.444244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aab91-4fdc-4429-afb5-d369caab8400 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.470297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.471039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.471307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.471564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.483435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:57.487722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.489578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.489578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.489578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:57.489834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:57.491014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 310/636] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:57.491915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.503902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:57.509458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:57.510368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 327/637] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:57.511745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.606386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0ad6b-1dad-4cc5-a7c1-a02d80d0f4a3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.617457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd498892-de95-495a-a8db-fc7ab3ac7c68 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.645761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.647087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.647644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.648211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.651769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.652405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.652715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.652982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.659689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:57.661680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:57.663436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:45:57.668547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:57.669570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 328/638] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:57.670429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.677557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:57.679815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:57.680789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:57.681695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:57.681695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:57.681695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:57.685748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 311/639] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:57.686643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.715999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.778843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860ddd-6aac-41a4-9a5b-da5a5b451561 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.794878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f59d0-2659-4fbf-9b15-2e93213cb47a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.814001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.814616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.814889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.815154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.815853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:57.816148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:57.817523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:57.825748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 329/640] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:57.826544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.835741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425464c-bb90-423e-865a-038041e61997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.836365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425464c-bb90-423e-865a-038041e61997 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.836631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425464c-bb90-423e-865a-038041e61997 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.836879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425464c-bb90-423e-865a-038041e61997 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.837544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425464c-bb90-423e-865a-038041e61997 None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:57.837874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425464c-bb90-423e-865a-038041e61997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:57.839284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425464c-bb90-423e-865a-038041e61997 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:57.849042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 312/641] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:57.849629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425464c-bb90-423e-865a-038041e61997 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:57.896821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.933625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b42fd-01d9-4785-af83-779aaf8d801a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.950631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:57.963871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425464c-bb90-423e-865a-038041e61997 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:57.968393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:57.969003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:57.969276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:57.969540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:57.970195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:57.970490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:57.971890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:57.980621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 330/642] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:57.981122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.008641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.009263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.009538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.009806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.010444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:58.010742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.012257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.025813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 313/643] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:58.027318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.093042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab402c2-29dc-449a-a3ef-fe88e0802a8b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.122034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:58.133002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.133817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.134094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.134365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.137308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030f3ef-8ce4-4712-ac1b-6556ae0533ea None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.146506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.148188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:58.163253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:58.164296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:58.165176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:58.165176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:58.165176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:58.165176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 331/644] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:58.165176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.175221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.175898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.176176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.176444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.189016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.190425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.201578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:58.208939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:58.210086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:58.211139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:58.211139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:58.211139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:58.218417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 314/645] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:58.219614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.276863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb844a7-1dd1-4cc1-b71d-304f7b1d86c7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.318698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.319335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.319611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.319921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.322103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3a92-411c-4c20-8f3f-9cec59780dbd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.331332 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.332822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:58.347825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:58.348754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:58.349615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:58.349615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:58.349615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:58.349615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 332/646] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:58.349868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.362434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.363072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.363340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.363607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.370391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.372177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.381356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:45:58.384028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:58.385551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:58.387645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 315/647] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:58.391180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.457344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:58.461953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c6345-8e8e-4d15-891d-2f4aceca0e7b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.498301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.498918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.499195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.499464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.500132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:58.500430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.501809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.508332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6bef0-9f60-4ff8-9090-c7faf9c391c7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.515366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 333/648] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:58.515366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.556795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.557411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.557760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.558028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.558663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:58.558950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.560347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.571989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 316/649] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:58.572809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.621727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:58.631294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e417b6-5ae5-408f-a6ef-bfdacae41e99 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.667407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.668047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.668320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.668584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.669225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:58.669503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.670883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.683020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 334/650] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:58.683859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.689702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676738fc-601d-48ba-9a48-40868a9f3ef9 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.711611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:58.731190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.732075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.732575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.732982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.733920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:58.734379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.736429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.748626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 317/651] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:58.749417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.797860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732514d-c9cf-4638-8efe-36e09fa22fd0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.836333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.836970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.837243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.837531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.845958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.847538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:58.859024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:58.860579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 335/652] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:58.861683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.870132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbe154-2209-4d92-bf4f-71c845e86ace None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.879579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:58.909014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:58.909783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:58.910123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:58.910393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:58.918162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:58.919587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:58.931589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:58.932623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:45:58.933640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:45:58.937330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 318/653] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:58.938140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:58.971357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c63b9-68d4-4c32-8b6d-a03d4031ef43 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:58.981078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.006236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.006868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.007140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.007401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.015100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.016561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:45:59.029677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:59.030802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:45:59.032064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:59.035426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 336/654] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:59.036280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:59.050375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f26f-366b-42a9-b380-7b14a126f956 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.090260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.090878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.091321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.091592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.092661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=ac2cabfcf8224f70a3129dc308e67b4f) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:59.092969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.094415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.100673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 319/655] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:45:58 2022] GET /identity/v3/role_assignments?user.id=ac2cabfcf8224f70a3129dc308e67b4f&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:59.101382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:59.130954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.179360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37aab3-d360-404b-815a-48868f900aa5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.217591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.218759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.219037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.219440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.220343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:59.220644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.222655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.244284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6c984-5fcc-418a-aea2-1356bc26e93b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.247936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 337/656] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:59.248964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:59.251962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.298844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.299481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.299780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.300044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.300784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:59.301079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.302501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.325293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 320/657] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:59.326459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:59.389395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b8f6-cf1f-4b85-acca-1344c93e332b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.424363 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.433201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.434128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.434581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.437539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.437539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:45:59.437539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.437539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.457051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 338/658] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:45:59.457253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7aaf3-e4e9-4823-8e36-d64d8a808060 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.458416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:59.493850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.494523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.494795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.495055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.525211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.565010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2c5f1-f495-4d9e-a27c-187f2601fc72 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.568493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.569969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.603112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15102092-d9c0-470c-9831-645c92341262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.605757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15102092-d9c0-470c-9831-645c92341262 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.606493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15102092-d9c0-470c-9831-645c92341262 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.607229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15102092-d9c0-470c-9831-645c92341262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.674054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 321/659] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:59.674919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:59.680911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.693700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15102092-d9c0-470c-9831-645c92341262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.695340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15102092-d9c0-470c-9831-645c92341262 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.746665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.784589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a68bd-1a4d-43a5-a5dd-8ad5d2e91e90 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.802175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 339/660] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:45:59.803644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56661c-c796-4cec-a74c-51f6308ec736 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.804202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56661c-c796-4cec-a74c-51f6308ec736 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.804471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56661c-c796-4cec-a74c-51f6308ec736 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.805911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 340/661] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:45:59.808858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56661c-c796-4cec-a74c-51f6308ec736 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:45:59.821497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8138-a0e5-4fe6-8197-22f679570ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.822107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8138-a0e5-4fe6-8197-22f679570ddb None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.822479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8138-a0e5-4fe6-8197-22f679570ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.822768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8138-a0e5-4fe6-8197-22f679570ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.895261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb8138-a0e5-4fe6-8197-22f679570ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.896744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb8138-a0e5-4fe6-8197-22f679570ddb None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.900320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.914948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56661c-c796-4cec-a74c-51f6308ec736 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:45:59.949583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:45:59.950220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:45:59.950497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:45:59.950760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:45:59.962500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:45:59.963326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:45:59.964641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:45:59.986427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:45:59.987455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:45:59.988368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:45:59.988368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:45:59.988368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:45:59.988368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 341/662] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:45:59.989057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.014155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 322/663] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:46:00.015427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a13a8c-c025-44f9-9c6e-6b27d34cc8d0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.015721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a13a8c-c025-44f9-9c6e-6b27d34cc8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.016435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a13a8c-c025-44f9-9c6e-6b27d34cc8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.035460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-48a13a8c-c025-44f9-9c6e-6b27d34cc8d0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:00.036789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-48a13a8c-c025-44f9-9c6e-6b27d34cc8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:00.094580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d80e7-7e96-4759-b762-d8b5e6d37561 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.124035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 323/664] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:00.124775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a13a8c-c025-44f9-9c6e-6b27d34cc8d0 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.129321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.130955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.130955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.130955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.142476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.145354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.147090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:00.174789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:00.175866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:00.176732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:00.176732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:00.176732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:00.180492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 342/665] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:00.181357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.238723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.250336 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a13a8c-c025-44f9-9c6e-6b27d34cc8d0 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.291911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a05d4e-0f57-4559-a463-ba15b03617c2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.293176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.295115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.295600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.296090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.296923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:00.297436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.299638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.314470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 324/666] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:00.315833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.337558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.338549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.339087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.339633 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.356055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.357798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:00.378886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:00.379928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:00.380839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:00.380839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:00.380839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:00.381768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 343/667] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:00.382271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.425319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a6a9d-bfc4-4222-bacd-52c15c91756a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.432075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.466989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.467811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.468092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.468360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.468996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:00.469296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.470671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.483918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 325/668] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:00.484570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.492721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d48e54-6073-4a14-a08e-eddabee9883b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.501035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.529480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.530112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.530387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.530645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.537512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.538967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:00.550273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:00.551142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 344/669] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:00.552081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.598674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a35f9-6271-4982-9cda-be38bc3133bd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.634728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.635335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.635605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.635994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.636803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:00.637097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.638874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.651807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 326/670] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:00.652645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.667372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d23a6-6c2a-447c-8588-100b527e5c3d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.669730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.704196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.704829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.705103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.705368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.715988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:00.721244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:00.722167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:00.722988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 345/671] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:00.723686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.733896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.768023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aaa41-7444-42f5-a058-544ebf7f4c7c None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.805762 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.806331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.806934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.807217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.815851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.817319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.829634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d429a-4906-47a3-b187-2a4a5e014095 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:00.830784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:00.831643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:00.832595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:00.833461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 327/672] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:00.834012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.872531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.873303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.873662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.873925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.874622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:00.874913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:00.876383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:00.893986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 346/673] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:00.893986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:00.919631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.947372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2fa5-94f7-4f27-8305-869dd2df9cf4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.980484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:00.990053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:00.990787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:00.991063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:00.991334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:00.997641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b7da1-eae4-4505-9393-08cd36e02475 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:00.998623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.000106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:01.012201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:01.013181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 328/674] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:01.019057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.038643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.039282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.039559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.039850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.040503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:01.040798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.042800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.051023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 347/675] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:46:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:01.051861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.128873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aec96-b200-431f-818b-07697eaf3af9 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:01.137843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:01.153649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dff43-be46-4f1a-8ff7-c29883b7a52a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:01.167335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.168590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.169040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.169587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.170544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:01.170944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.172445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.184479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 329/676] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:01.189477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.193664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.194245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.194544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.194787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.195536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=6083dd9ef4544aa6a596915f5b899b8c) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:01.195838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.197304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.215735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 348/677] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/role_assignments?user.id=6083dd9ef4544aa6a596915f5b899b8c&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:01.215735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.257683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:01.318241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141da4f7-2a5e-4c65-9139-eb68cd311b28 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:01.349749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3c0ae-530c-464b-a994-4ffe263625bf None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:01.360822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.361577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.361974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.362308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.363068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:01.363433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.365147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.384311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 330/678] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:01.385347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.390977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.391630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.391930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.392193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.404148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.405622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:01.421138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:01.422159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:01.423669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:01.423669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:01.423669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:01.423669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 349/679] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:01.423669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.426624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:01.516575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bedca6-52a6-47ec-988f-f615a0411b66 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:01.530620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:01.536173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e99e-38a8-48fb-9bf0-e44dd0627979 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:01.555351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.556004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.556279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.556550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.557275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=faee06d60a484eebb6a9fb31ce0878d5) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:01.557650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.559608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.566094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 331/680] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/role_assignments?user.id=faee06d60a484eebb6a9fb31ce0878d5&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:01.566880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.574482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0a4cd-5a50-48f7-b3bc-337800aedf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.575499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a4cd-5a50-48f7-b3bc-337800aedf98 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.576005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a4cd-5a50-48f7-b3bc-337800aedf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.576492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a4cd-5a50-48f7-b3bc-337800aedf98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.577440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0a4cd-5a50-48f7-b3bc-337800aedf98 None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=3a022b80e5eb460b92e4e99728b22770) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:01.577940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0a4cd-5a50-48f7-b3bc-337800aedf98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.579513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0a4cd-5a50-48f7-b3bc-337800aedf98 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.586722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 350/681] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/role_assignments?user.id=3a022b80e5eb460b92e4e99728b22770&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:01.587965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e0918-9fec-4277-a7ab-8a0abdbf1644 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.588311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e0918-9fec-4277-a7ab-8a0abdbf1644 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.588653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e0918-9fec-4277-a7ab-8a0abdbf1644 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.594579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 351/682] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:01.595958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf48d1-6789-44c8-b3ba-8d2d9afe945d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.596310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf48d1-6789-44c8-b3ba-8d2d9afe945d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.596584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf48d1-6789-44c8-b3ba-8d2d9afe945d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.625047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-eebf48d1-6789-44c8-b3ba-8d2d9afe945d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:01.626350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-eebf48d1-6789-44c8-b3ba-8d2d9afe945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:01.748827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:01.758106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 352/683] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:01.771742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dbd23-57ad-4b05-a4b0-8d625adb3a81 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:01.807463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:01.808258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:01.808530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:01.808794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:01.809443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:01.809738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:01.811119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:01.824776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 332/684] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:01.830578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf48d1-6789-44c8-b3ba-8d2d9afe945d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:01.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf48d1-6789-44c8-b3ba-8d2d9afe945d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:02.000227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:02.000777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:02.001053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:02.001318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:02.010327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:02.011937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:02.024877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:02.025862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:02.026846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:02.029124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 353/685] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:02.032622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:02.067947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:02.071304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:02.140984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:02.210635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfbb9c-cd3b-481e-8188-efa7b6a13b85 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:02.237087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b298a-86d7-4feb-b87c-dd9eeb98659a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:02.263552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:02.264115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:02.264383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:02.264646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:02.265375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:02.265670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:02.267100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:02.292595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 333/686] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Sep 15 12:46:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:02.299326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:02.304878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:02.305531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:02.305802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:02.306061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:02.319368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:02.325471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:02.326432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:02.327272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:02.329992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 354/687] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:02.337532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:02.407006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:02.417622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2791c1e-da6a-47c3-b7d3-25ba95883074 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:02.480844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:02.481466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:02.481739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:02.482009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:02.525970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ffc91-d02b-43e2-89f1-d02110b3f0e7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:02.560226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:02.599796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:02.601320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:02.606140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:02.606771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:02.607046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:02.607311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:02.608002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:02.608299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:02.609684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:02.627257 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 355/688] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:02.632849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:02.703735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:02.713258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 334/689] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:46:02.714649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:02.822170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef27d0-ea8d-4d00-86f9-a8bfe60087ff None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:02.858124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035074d-5716-49aa-a577-e88644218599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:02.858820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035074d-5716-49aa-a577-e88644218599 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:02.859096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035074d-5716-49aa-a577-e88644218599 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:02.859412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035074d-5716-49aa-a577-e88644218599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:02.870767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035074d-5716-49aa-a577-e88644218599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:02.872253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035074d-5716-49aa-a577-e88644218599 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-0035074d-5716-49aa-a577-e88644218599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:02.887915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:02.890088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:02.892143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:02.892143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:02.892143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:02.894424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 335/690] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:02.895538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035074d-5716-49aa-a577-e88644218599 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:02.913766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c8f7-f30a-4ed4-828b-af2d4e93f3b6 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:02.962077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:03.011934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035074d-5716-49aa-a577-e88644218599 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:03.032489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.033152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.033427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.033693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.048557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.049181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.049454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.049717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.050351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:03.050746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.052155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.061150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.062682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.079904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 336/691] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:03.088829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:03.090927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:03.093059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:03.093059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:03.093059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:03.093059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 356/692] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:03.093554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:03.100769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:03.177330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:03.213272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae9f4-32f5-4ef0-83a9-8b313462f848 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:03.229460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:03.276524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.277176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.277447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.277713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.289835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eb509-5e2b-44f1-9073-5d081d10dfe7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:03.298651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.300147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:03.314946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:03.316228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:03.317109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:03.319826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 337/693] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:03.326418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:03.361686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.362684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.363170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.363620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.364485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:03.364978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.366704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.393604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 357/694] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:03.400617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:03.513531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118f1c-52ea-48f0-8475-923f7929c61f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:03.568080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:03.585343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85238b47-87f2-4928-9671-52b26e9607b3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:03.587973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.588703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.589013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.589274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.589964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:03.590266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.593291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.619748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 338/695] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:03.626442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:03.661308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dafc7d-5787-4e30-81fa-0fddf13e4187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.662057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dafc7d-5787-4e30-81fa-0fddf13e4187 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.662338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dafc7d-5787-4e30-81fa-0fddf13e4187 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.662599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dafc7d-5787-4e30-81fa-0fddf13e4187 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.668016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:03.671678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dafc7d-5787-4e30-81fa-0fddf13e4187 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.673911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dafc7d-5787-4e30-81fa-0fddf13e4187 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c0dafc7d-5787-4e30-81fa-0fddf13e4187 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:03.686410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:03.687435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 358/696] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:46:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd9628-9299-4969-90d4-1694ba672786 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.689581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd9628-9299-4969-90d4-1694ba672786 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.691211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd9628-9299-4969-90d4-1694ba672786 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.691211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 359/697] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:03.696096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd9628-9299-4969-90d4-1694ba672786 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:03.755443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ecfb8-21d6-4f91-8f17-c6617e2b08e5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:03.793900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5d39-563d-4e89-bf5b-a5bb5ec81c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.794584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5d39-563d-4e89-bf5b-a5bb5ec81c5c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.794851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5d39-563d-4e89-bf5b-a5bb5ec81c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.795114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5d39-563d-4e89-bf5b-a5bb5ec81c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.795878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5d39-563d-4e89-bf5b-a5bb5ec81c5c None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=75b6057e2fd7438cb3fa2a0ec2933fcc) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:03.796176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5d39-563d-4e89-bf5b-a5bb5ec81c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.798529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab5d39-563d-4e89-bf5b-a5bb5ec81c5c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.808325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd9628-9299-4969-90d4-1694ba672786 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:03.812075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 339/698] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:03 2022] GET /identity/v3/role_assignments?user.id=75b6057e2fd7438cb3fa2a0ec2933fcc&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:03.813776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e675bd-84c1-4f84-989e-5cf2d90abfbf None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.814053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e675bd-84c1-4f84-989e-5cf2d90abfbf None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.814317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e675bd-84c1-4f84-989e-5cf2d90abfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.847433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:03.848184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:03.848522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:03.848850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:03.849665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:03.850027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:03.851657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:03.852488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a2e675bd-84c1-4f84-989e-5cf2d90abfbf None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:03.853890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a2e675bd-84c1-4f84-989e-5cf2d90abfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:03.893739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 360/699] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:46:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:03.899399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:03.920553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:04.013094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 340/700] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:04.056940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fede9-6aee-443a-ad10-a4aa0e487ef5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:04.095184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:04.096204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.096690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.097173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.186527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:04.191871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:04.206570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:04.343210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e675bd-84c1-4f84-989e-5cf2d90abfbf None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:04.346775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 361/701] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:46:04.355426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:04.371687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:04.479121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e675bd-84c1-4f84-989e-5cf2d90abfbf None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:04.491027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36e9b2-21c8-4f24-89e8-dcd1ef7d4ee7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:04.502358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:04.533949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd814682-15af-4b21-8a4d-2040b0bb9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:04.534396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6321ff8-a8bc-4bee-80a8-9a9e7bb43cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:04.535030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd814682-15af-4b21-8a4d-2040b0bb9f5f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.535183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ff8-a8bc-4bee-80a8-9a9e7bb43cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.535278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ff8-a8bc-4bee-80a8-9a9e7bb43cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.535553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6321ff8-a8bc-4bee-80a8-9a9e7bb43cc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.535835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd814682-15af-4b21-8a4d-2040b0bb9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.536246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd814682-15af-4b21-8a4d-2040b0bb9f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.548635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd814682-15af-4b21-8a4d-2040b0bb9f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:04.550342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd814682-15af-4b21-8a4d-2040b0bb9f5f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:04.552141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321ff8-a8bc-4bee-80a8-9a9e7bb43cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:04.553596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6321ff8-a8bc-4bee-80a8-9a9e7bb43cc5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fd814682-15af-4b21-8a4d-2040b0bb9f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:04.569321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:04.570462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:04.571498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:04.571498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:04.571498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-a6321ff8-a8bc-4bee-80a8-9a9e7bb43cc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:04.571778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:04.572817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:04.574065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:04.574065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:04.574065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:04.574065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 341/702] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:04.574764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632549-56da-4c07-a257-96b4bee776c3 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.575042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632549-56da-4c07-a257-96b4bee776c3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.575310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b632549-56da-4c07-a257-96b4bee776c3 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.576238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 362/703] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:04.577654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929243-753d-4b42-b715-39155bdc3dd2 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.578061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929243-753d-4b42-b715-39155bdc3dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.578453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929243-753d-4b42-b715-39155bdc3dd2 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.581049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 342/704] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:04.581769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632549-56da-4c07-a257-96b4bee776c3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:04.582772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 363/705] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:04.584056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3857b-e451-49d4-a5eb-59ddbb03f4f7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.584576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3857b-e451-49d4-a5eb-59ddbb03f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.584818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3857b-e451-49d4-a5eb-59ddbb03f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.612851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9af3857b-e451-49d4-a5eb-59ddbb03f4f7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:04.614350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9af3857b-e451-49d4-a5eb-59ddbb03f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:04.671004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:04.700861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 364/706] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:04.707613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3857b-e451-49d4-a5eb-59ddbb03f4f7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:04.711203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b632549-56da-4c07-a257-96b4bee776c3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:04.759587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263cf18-2dd4-45af-83af-b31de18a51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:04.761387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263cf18-2dd4-45af-83af-b31de18a51a9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.761552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263cf18-2dd4-45af-83af-b31de18a51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.761954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263cf18-2dd4-45af-83af-b31de18a51a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.763731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263cf18-2dd4-45af-83af-b31de18a51a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:04.763731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263cf18-2dd4-45af-83af-b31de18a51a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:04.765704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263cf18-2dd4-45af-83af-b31de18a51a9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:04.790304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 343/707] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:04.790304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b079c-9afd-422f-996d-ee74c4265f34 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.790304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b079c-9afd-422f-996d-ee74c4265f34 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.790304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b079c-9afd-422f-996d-ee74c4265f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.817841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f09b079c-9afd-422f-996d-ee74c4265f34 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:04.821295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f09b079c-9afd-422f-996d-ee74c4265f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:04.833999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:04.847598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3857b-e451-49d4-a5eb-59ddbb03f4f7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:04.901601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:04.903670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:04.904279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:04.904734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:04.905842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:04.906419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:04.908284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:04.928602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 344/708] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:04.930123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b079c-9afd-422f-996d-ee74c4265f34 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:04.933505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 365/709] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:04.934640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.019585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:05.078475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b079c-9afd-422f-996d-ee74c4265f34 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.080059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29ffc-be1e-4f81-bc15-0f8fa8bdfd14 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.120570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.121218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.121497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.121765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.130716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.132218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.136586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.137448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.137926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.138370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.139194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.141503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:05.145373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:05.146253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:05.147145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 366/710] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:05.147739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.163078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:05.184243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 345/711] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:46:04 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:05.186234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.311661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85b3a-f878-4e1c-9d87-e72018450a43 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.328805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f59cd8-221d-43d9-9ef2-9e090cc64d85 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.356416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.357170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.357502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:05.357903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.358748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.359577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.361609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:05.378018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:05.379130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:05.380031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:05.383760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 367/712] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:05.383760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.384943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.385829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.386237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.387092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.388166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:05.389617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.394223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.411764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 346/713] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:05.412773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.486260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:05.522534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952169-8407-4d55-b8c9-1740cbc418ba None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.549775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f76e1-dc08-41fe-9532-bc81ffb1de8a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.570622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.571806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.572634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.573188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] PATH_INFO: `/v3/services/network` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.574095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.576297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:05.588226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:05.589365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:05.592696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 368/714] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:05.593484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.600886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.601606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.601953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.602290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.602996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:05.603380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.605049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.610963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 347/715] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:05.615626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.662913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:05.703199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d94a96-66e5-41e5-b40c-44c6c7d2817b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.736652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4a50f-f716-4e5d-9b8f-f15f87e609ee None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.738522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.739357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.739872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.740356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.741263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=ac2cabfcf8224f70a3129dc308e67b4f) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:05.741754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.743364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.749675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 369/716] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/role_assignments?user.id=ac2cabfcf8224f70a3129dc308e67b4f&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:05.750811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.753779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:05.777122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.778325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.778781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.779223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.780235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] RBAC: Adding query filter params (name=network) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:05.780425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.781835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.791776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 348/717] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:05.799753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:05.914796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6e55-7dda-437b-9244-dc1f3f5b9326 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:05.922965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:05.955668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cf4c2-bc47-46e0-9b9f-82831b94c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:05.956482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cf4c2-bc47-46e0-9b9f-82831b94c86f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:05.956759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cf4c2-bc47-46e0-9b9f-82831b94c86f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:05.957025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cf4c2-bc47-46e0-9b9f-82831b94c86f None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:05.957773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cf4c2-bc47-46e0-9b9f-82831b94c86f None admin] RBAC: Adding query filter params (type=network) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:05.958077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cf4c2-bc47-46e0-9b9f-82831b94c86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:05.959466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cf4c2-bc47-46e0-9b9f-82831b94c86f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:05.971814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 349/718] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:06.015085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f66c2-a63f-451b-9108-9bd6bc0c8d9f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:06.073163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7770eae-8ec4-4798-8832-14a4564b2786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:06.073765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7770eae-8ec4-4798-8832-14a4564b2786 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:06.074040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7770eae-8ec4-4798-8832-14a4564b2786 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:06.074305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7770eae-8ec4-4798-8832-14a4564b2786 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:06.074957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7770eae-8ec4-4798-8832-14a4564b2786 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:06.075250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7770eae-8ec4-4798-8832-14a4564b2786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:06.076694 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7770eae-8ec4-4798-8832-14a4564b2786 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:06.086347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 370/719] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Sep 15 12:46:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:06.702575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2a62-3b62-45b8-834f-6ff7b97c679f None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:06.702761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2a62-3b62-45b8-834f-6ff7b97c679f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:06.703030 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2a62-3b62-45b8-834f-6ff7b97c679f None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:06.704655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 350/720] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:06.711900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f953-c999-4430-8c7e-a5b82c870e85 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:06.712419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f953-c999-4430-8c7e-a5b82c870e85 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:06.712609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283f953-c999-4430-8c7e-a5b82c870e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:06.737214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0283f953-c999-4430-8c7e-a5b82c870e85 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:06.738884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0283f953-c999-4430-8c7e-a5b82c870e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:06.821296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:06.829537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 371/721] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:07.241889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef2a62-3b62-45b8-834f-6ff7b97c679f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:07.358708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef2a62-3b62-45b8-834f-6ff7b97c679f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:07.400331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:07.401382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:07.401950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:07.402439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:07.417811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:07.422997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:07.423969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:07.424796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:07.427380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 351/722] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:07.434224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283f953-c999-4430-8c7e-a5b82c870e85 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:07.591250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283f953-c999-4430-8c7e-a5b82c870e85 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:07.637067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10903f9c-5230-4e46-97bd-0ba9a226bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:07.637689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903f9c-5230-4e46-97bd-0ba9a226bf12 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:07.637962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903f9c-5230-4e46-97bd-0ba9a226bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:07.638227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903f9c-5230-4e46-97bd-0ba9a226bf12 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:07.638889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10903f9c-5230-4e46-97bd-0ba9a226bf12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:07.639186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10903f9c-5230-4e46-97bd-0ba9a226bf12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:07.640587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10903f9c-5230-4e46-97bd-0ba9a226bf12 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:07.649344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 372/723] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:07.654944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:07.709441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:07.807134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04722-01dd-4508-88f4-a2e6fe15da88 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:07.855597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:07.856550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:07.857050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:07.857454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:07.860088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f34011-1607-4284-8156-f419b3c88066 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:07.860088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f34011-1607-4284-8156-f419b3c88066 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:07.860088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f34011-1607-4284-8156-f419b3c88066 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:07.861945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 373/724] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:07.868723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b0b9-f168-4384-ab98-a0fa31d404fe None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:07.869233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b0b9-f168-4384-ab98-a0fa31d404fe None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:07.869745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9b0b9-f168-4384-ab98-a0fa31d404fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:07.871668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:07.873148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:07.889621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:07.890994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:07.891893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:07.891893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:07.891893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:07.891893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 352/725] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:07.899718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:07.907328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-53b9b0b9-f168-4384-ab98-a0fa31d404fe None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:07.908810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-53b9b0b9-f168-4384-ab98-a0fa31d404fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:07.979335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:07.998344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae75e2d-78a2-401a-bc36-42cb75fe88d2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:08.011577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:08.033319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:08.034261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.034450 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.034807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.035578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:08.035942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:08.038906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:08.045429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 374/726] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:08.050706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 353/727] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:08.056230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9b0b9-f168-4384-ab98-a0fa31d404fe None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:08.221147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9b0b9-f168-4384-ab98-a0fa31d404fe None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:08.272409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:08.273047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.273483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.273749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.281740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:08.283193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:08.299888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:08.301095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:08.302499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 375/728] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:08.306744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:08.380906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:08.428187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22072672-dcd7-4025-905a-3ac4f52aed3e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:08.480554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:08.492462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:08.493094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.493367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.493632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.494368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:08.494707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:08.496361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:08.527907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:08.537934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 354/729] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Sep 15 12:46:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:08.538921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed703-ba3b-4fb9-9d9a-45597e7f4255 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:08.548707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:08.589556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d164ef-ff57-45c4-a9fc-97f5e152abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:08.590220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d164ef-ff57-45c4-a9fc-97f5e152abdd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.590489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d164ef-ff57-45c4-a9fc-97f5e152abdd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.590752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d164ef-ff57-45c4-a9fc-97f5e152abdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.613796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d164ef-ff57-45c4-a9fc-97f5e152abdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-76d164ef-ff57-45c4-a9fc-97f5e152abdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:08.620913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:08.621935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:08.622776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:08.623940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 376/730] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:46:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:08.632821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db0f94-782c-48b6-a45f-2d48fce5401c None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.633065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db0f94-782c-48b6-a45f-2d48fce5401c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.633327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db0f94-782c-48b6-a45f-2d48fce5401c None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.634893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 377/731] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:08.635805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db0f94-782c-48b6-a45f-2d48fce5401c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:08.696235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a7fc-daf4-47e0-ac4b-dbb5f9c17542 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:08.740294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761cac7-088c-4aec-aaee-d22a4ea66547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:08.740831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761cac7-088c-4aec-aaee-d22a4ea66547 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.741101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761cac7-088c-4aec-aaee-d22a4ea66547 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.741364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761cac7-088c-4aec-aaee-d22a4ea66547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.760911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db0f94-782c-48b6-a45f-2d48fce5401c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:08.770581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:08.797494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b502b-e740-4f36-a30c-71a705bb613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:08.798103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b502b-e740-4f36-a30c-71a705bb613f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.798376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b502b-e740-4f36-a30c-71a705bb613f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.798640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b502b-e740-4f36-a30c-71a705bb613f None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.799331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b502b-e740-4f36-a30c-71a705bb613f None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:08.799590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b502b-e740-4f36-a30c-71a705bb613f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:08.800998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b502b-e740-4f36-a30c-71a705bb613f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:08.811753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 378/732] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:46:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:08.811753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3c9d-b0bf-47cc-930f-f44e62c96517 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.811753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3c9d-b0bf-47cc-930f-f44e62c96517 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.811753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd3c9d-b0bf-47cc-930f-f44e62c96517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.820017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:08.823169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761cac7-088c-4aec-aaee-d22a4ea66547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:08.825506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761cac7-088c-4aec-aaee-d22a4ea66547 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:08.830512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a3fd3c9d-b0bf-47cc-930f-f44e62c96517 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:08.831727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a3fd3c9d-b0bf-47cc-930f-f44e62c96517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:08.897858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 379/733] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:08.898947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8de1-7114-49ef-ba42-66a0bd06f8c4 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:08.899223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8de1-7114-49ef-ba42-66a0bd06f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:08.899485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8de1-7114-49ef-ba42-66a0bd06f8c4 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:08.900824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 380/734] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:08.902113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed8de1-7114-49ef-ba42-66a0bd06f8c4 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.014058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.018578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed8de1-7114-49ef-ba42-66a0bd06f8c4 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.052484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 355/735] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:46:09.054468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e0a59-8146-4aad-9baf-f9ee0fef8269 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.054986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e0a59-8146-4aad-9baf-f9ee0fef8269 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.055463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e0a59-8146-4aad-9baf-f9ee0fef8269 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.058781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.059492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.059782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.060197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.061928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 356/736] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:09.063365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b336-42a5-4e1b-b0bc-c7fb162ec689 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.063876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b336-42a5-4e1b-b0bc-c7fb162ec689 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.064155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b336-42a5-4e1b-b0bc-c7fb162ec689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.071879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.072693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.082295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5755b336-42a5-4e1b-b0bc-c7fb162ec689 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:09.083493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5755b336-42a5-4e1b-b0bc-c7fb162ec689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:09.087663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:09.088736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:09.089655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:09.089655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:09.089655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:09.093563 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 381/737] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:09.094219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.154126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 357/738] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:09.155552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494b5c9-13d7-4695-be47-fee755347885 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.155869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494b5c9-13d7-4695-be47-fee755347885 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.156139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494b5c9-13d7-4695-be47-fee755347885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.174639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4494b5c9-13d7-4695-be47-fee755347885 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:09.175852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4494b5c9-13d7-4695-be47-fee755347885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:09.201114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.207477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368d51d-a402-4f59-986c-d0d695f17b75 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.244137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.245028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.245332 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.245611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.250061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 358/739] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:46:09.251174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494b5c9-13d7-4695-be47-fee755347885 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.260949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.262085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:09.284162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:09.285124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:09.286006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:09.286006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:09.286006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:09.287838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 382/740] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:09.288825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.293915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.371439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494b5c9-13d7-4695-be47-fee755347885 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.406309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.406964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.407188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.407453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.408122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:09.408415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.409789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.410276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fec01-7732-4d90-a937-85b1c22db6f9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.421822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 359/741] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:09.422636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.445954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.453741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.454572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.454852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.455270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.467642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:09.473000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:09.473927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:09.474744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 383/742] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:09.475425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.540133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc56ede-b4de-4b84-a2d3-e52bdd53a1bf None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.544290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.574501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.575357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.575629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.575926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.576564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:09.576857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.578222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.580579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78dd9a-3ee5-4d7c-a8b6-3013c72e436d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.589029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 360/743] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:09.589820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.619604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.620288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.620557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.620822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.621463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.622838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.639473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 384/744] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:09 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:09.640325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.678027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.700808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39481-a699-46ad-91d3-6ec7b3c001d0 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.755180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.755425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9c709-de66-4511-8b49-4583d9d45a6b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.755872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.756143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.756407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.765160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.766762 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.776556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:09.780994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:09.782164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 361/745] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:09.783101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.799750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.800276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.800538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.800797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.801474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:09.801765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.803181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.813840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 385/746] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:09.815369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.900927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31b819-491e-4969-b900-5c80ceefb6ad None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.930049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c6fbd-e588-4b5f-9186-0d63a1acba5a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:09.935888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.936508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.936785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.937050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.937705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.939073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:09.944448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:09.958439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 362/747] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:09 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:09.959243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:09.978693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:09.980022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:09.980579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:09.981095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:09.990426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:09.992399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:10.006597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:10.007559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:10.008489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:10.016241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 386/748] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:10.017789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.066538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:10.096159 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bd2e4-2ae1-4e81-bbf4-a71c6c340dd8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.138138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.139180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.139458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.139760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.140615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:10.140919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.142370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.146338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680885e6-7740-42b4-8963-47eb07cdfdff None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.161542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 363/749] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Sep 15 12:46:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:10.162458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.196785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.197437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.197828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.198100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.212800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.214296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:10.229789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:10.231021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:10.232042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:10.232042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:10.232042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:10.232042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 387/750] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:10.232283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.248556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:10.305621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7364ab-8abe-4f72-b94f-b6c9ec7c73bf None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.336106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:10.342202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.342817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.343085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.343344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.344081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:10.344377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.345800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.347648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357805f8-799a-4777-882a-aa87bb08c8c4 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.358363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 364/751] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:10.359195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.386188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.386813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.387095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.387454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.462097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfda19-eebf-4166-8185-bd813f781411 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.462565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.464005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.477407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:10.500764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.501570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.501844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.502317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.502953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:10.503244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.505313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.518606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 365/752] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:10.518606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.568437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:10.582041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 388/753] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:10.583229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.626687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7b04b-ff8c-4f6a-ab32-302a9a38b1e4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.660296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.661284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.661284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.661516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.662139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=75b6057e2fd7438cb3fa2a0ec2933fcc) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:10.662434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.663925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.670085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 366/754] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/role_assignments?user.id=75b6057e2fd7438cb3fa2a0ec2933fcc&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:10.670891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.695195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60971e-d073-48b5-a690-be1789a728f2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.713686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:10.738114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.739225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.739723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.740191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.748787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.750593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:10.764312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:10.765337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:10.766288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:10.769063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 389/755] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:10.785494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.786567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e463-2187-41ac-a420-3db9de9b8f3e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:10.828330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:10.828975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:10.829298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:10.829500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:10.852091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:10.853573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:10.886196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:10.887166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:10.888350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:10.888350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:10.888350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:10.888350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 367/756] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:10.896705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:10.906954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:10.983177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226342d-c137-45ae-a2fe-d5fa16897f0e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.024859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.026094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.026603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.027087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.028050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:11.029026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:11.030847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:11.050923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 390/757] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:11.056732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:11.106027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:11.127009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e4a8-9430-4c5b-9635-d6bbe1b4e9e0 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.181381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.183546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.184080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.185402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.186248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:11.187847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:11.191789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:11.213463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 368/758] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:11.219087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:11.264980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abeb9d-74ad-4ee4-a985-d53908330856 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.277435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:11.315479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.316160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.316425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.316688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.327445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:11.329063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:11.357264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:11.358299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:11.360195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:11.360195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:11.360195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:11.360195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 391/759] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:11.364604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:11.380949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33c750-ae12-44ac-9d3c-50afbca83d54 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.418157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.419169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.419667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.420155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.427737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:11.429595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:11.442882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:11.443821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:11.444716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:11.447353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 369/760] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:11.452823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:11.468111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:11.563676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504df0d1-924a-4b8e-ba5e-cff110ce0719 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.623608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.625542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.627368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.627881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.628812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:11.630588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:11.632290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:11.658194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 370/761] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:11.658706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a1de9-1275-47a9-a4b4-790e37e05bd5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.663879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:11.695069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.696065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.696545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.697017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.697976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:11.698492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:11.700112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:11.734053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 392/762] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:11.739985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:11.774742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:11.783519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:11.817101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003cdba-fce3-4c88-8c3d-c0842688da3f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.883600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d126bf-3f1c-483a-bd78-78f1f3f0aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.884252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d126bf-3f1c-483a-bd78-78f1f3f0aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.884523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d126bf-3f1c-483a-bd78-78f1f3f0aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.884788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d126bf-3f1c-483a-bd78-78f1f3f0aaf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.885793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d126bf-3f1c-483a-bd78-78f1f3f0aaf4 None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=b2684f91284d49fc98b4caaace8cbba4) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:11.886279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d126bf-3f1c-483a-bd78-78f1f3f0aaf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:11.887774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d126bf-3f1c-483a-bd78-78f1f3f0aaf4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:11.903069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 371/763] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:11 2022] GET /identity/v3/role_assignments?user.id=b2684f91284d49fc98b4caaace8cbba4&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:11.934769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40540c4e-f5b9-4d8c-991e-45b71e1275f2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:11.984192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:11.985160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:11.985413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:11.985625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:11.999977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:12.001464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:12.018806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298b535-6146-4403-b89a-0c395e7efe80 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.019435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298b535-6146-4403-b89a-0c395e7efe80 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.019943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298b535-6146-4403-b89a-0c395e7efe80 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:12.022994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:12.024199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:12.025285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 393/765] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:12.026192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 372/765] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:12.029690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:12.031265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a62ce4-4ae5-42a6-9084-812d37057eb2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.031553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a62ce4-4ae5-42a6-9084-812d37057eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.031847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a62ce4-4ae5-42a6-9084-812d37057eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.060727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-90a62ce4-4ae5-42a6-9084-812d37057eb2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:12.062287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-90a62ce4-4ae5-42a6-9084-812d37057eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:12.149250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:12.171503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d44e-902f-4fcc-9e6b-24d0e32fd528 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:12.215746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 373/766] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:12.233416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc34b6-b51f-4a11-861d-7be4ea23383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:12.234052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc34b6-b51f-4a11-861d-7be4ea23383b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.234388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc34b6-b51f-4a11-861d-7be4ea23383b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.234944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc34b6-b51f-4a11-861d-7be4ea23383b None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.235647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc34b6-b51f-4a11-861d-7be4ea23383b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:12.236065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc34b6-b51f-4a11-861d-7be4ea23383b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:12.237535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc34b6-b51f-4a11-861d-7be4ea23383b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:12.259203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 394/767] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:12.265160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a62ce4-4ae5-42a6-9084-812d37057eb2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:12.374909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:12.431984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a62ce4-4ae5-42a6-9084-812d37057eb2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:12.481975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388db2e2-7872-405c-a575-ca956b2e0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:12.482764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388db2e2-7872-405c-a575-ca956b2e0249 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.483158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388db2e2-7872-405c-a575-ca956b2e0249 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.483554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388db2e2-7872-405c-a575-ca956b2e0249 None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/ac2cabfcf8224f70a3129dc308e67b4f/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.486900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388db2e2-7872-405c-a575-ca956b2e0249 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=ac2cabfcf8224f70a3129dc308e67b4f, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:12.489083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388db2e2-7872-405c-a575-ca956b2e0249 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:12.503403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b934-1625-425b-bb44-2c40af14251b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.503767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b934-1625-425b-bb44-2c40af14251b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.504081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b934-1625-425b-bb44-2c40af14251b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.506128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 395/768] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:12.506741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b934-1625-425b-bb44-2c40af14251b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:12.513274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 374/769] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:46:12 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/ac2cabfcf8224f70a3129dc308e67b4f/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:46:12.515031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69810-b979-441a-b2e3-5fb99c0b904b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.515472 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69810-b979-441a-b2e3-5fb99c0b904b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.515963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69810-b979-441a-b2e3-5fb99c0b904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.536469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-6ed69810-b979-441a-b2e3-5fb99c0b904b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:12.537771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6ed69810-b979-441a-b2e3-5fb99c0b904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:12.660663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 375/770] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:12.696556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b934-1625-425b-bb44-2c40af14251b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:12.738364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:12.738920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.739193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.739457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.740058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:12.741530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:12.752493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:12.753522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:12.754371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 396/771] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:12 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:12.760036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed69810-b979-441a-b2e3-5fb99c0b904b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:12.836338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:12.905088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed69810-b979-441a-b2e3-5fb99c0b904b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:12.961293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:12.961918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:12.962191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:12.962447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:12.963367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] RBAC: Adding query filter params (name=network) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:12.963667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:12.965060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:12.975534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 376/772] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:12.981459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:12.985625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:13.112942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91359e5-1954-413d-8c92-e33fb43cc4a9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:13.118639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:13.165204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:13.165825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.166166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.166479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.167119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] RBAC: Adding query filter params (type=network) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:13.167411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:13.170691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:13.181133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 397/773] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:13.187199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:13.279056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f2c92-58f4-4c43-b38d-c143631b4088 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:13.305098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:13.311782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:13.322593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e7d8e-94ef-4d64-94c9-43a72cdc7cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:13.323441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e7d8e-94ef-4d64-94c9-43a72cdc7cca None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.323679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e7d8e-94ef-4d64-94c9-43a72cdc7cca None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.323894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e7d8e-94ef-4d64-94c9-43a72cdc7cca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.324473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e7d8e-94ef-4d64-94c9-43a72cdc7cca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:13.325821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e7d8e-94ef-4d64-94c9-43a72cdc7cca None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-0f6e7d8e-94ef-4d64-94c9-43a72cdc7cca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:13.336978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:13.338043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:13.339537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:13.343107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 377/774] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Sep 15 12:46:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:13.344436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d316f2-9eed-4d76-b832-8fe094b7c777 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.344718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d316f2-9eed-4d76-b832-8fe094b7c777 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.345031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d316f2-9eed-4d76-b832-8fe094b7c777 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.350274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 378/775] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:13.350274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d316f2-9eed-4d76-b832-8fe094b7c777 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:13.365295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1edf3c-51fb-4385-8974-7494e48b442a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:13.401198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14facf5-60cd-4b49-838f-116b61cbaf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:13.401729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14facf5-60cd-4b49-838f-116b61cbaf23 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.402001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14facf5-60cd-4b49-838f-116b61cbaf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.402259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14facf5-60cd-4b49-838f-116b61cbaf23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.402946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14facf5-60cd-4b49-838f-116b61cbaf23 None admin] RBAC: Adding query filter params (interface=public, service_id=39e3ecad8f3f42b39c3cdabb74b0d053, region_id=RegionOne) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:13.403244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14facf5-60cd-4b49-838f-116b61cbaf23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:13.404659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14facf5-60cd-4b49-838f-116b61cbaf23 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:13.412656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 398/776] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:46:13 2022] GET /identity/v3/endpoints?service_id=39e3ecad8f3f42b39c3cdabb74b0d053&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:13.413983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551995b5-d2bf-4680-b22a-46b47aad09eb None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.414261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551995b5-d2bf-4680-b22a-46b47aad09eb None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.414527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551995b5-d2bf-4680-b22a-46b47aad09eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.436085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-551995b5-d2bf-4680-b22a-46b47aad09eb None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:13.437288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-551995b5-d2bf-4680-b22a-46b47aad09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:13.476973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d316f2-9eed-4d76-b832-8fe094b7c777 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:13.513716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 399/777] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:13.514784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551995b5-d2bf-4680-b22a-46b47aad09eb None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:13.517560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:13.519526 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.519973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.520381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.521155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:13.521616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:13.523204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:13.529928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 379/778] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Sep 15 12:46:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:13.537131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:13.620720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:13.632753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:13.691747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551995b5-d2bf-4680-b22a-46b47aad09eb None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:13.730946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:13.731615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.731939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.732207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.732817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:13.734218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:13.744794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 400/779] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:13 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:13.758946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aba289-25c2-4f7e-b5d7-dad5f0436da9 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:13.804510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:13.848473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:13.849085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:13.849360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:13.849624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:13.850267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:13.850564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:13.852004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:13.866655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 380/780] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Sep 15 12:46:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:13.872740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:13.967876 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbdef7-da85-433b-8b1c-1c541abc00c3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:14.006472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:14.019472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:14.020300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.020672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.021046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.034031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:14.039922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:14.041134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:14.042437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:14.044258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 401/781] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:14.050882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:14.062502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4fe39-f48a-4d18-875a-8f9daeaeec4e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:14.081035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:14.128255 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:14.128794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.129072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.129338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.130045 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] RBAC: Adding query filter params (interface=public, service_id=2a557ae65b2d408089aa5fc69868cab6, region_id=RegionOne) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:14.130348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:14.131731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:14.152439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 381/782] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:46:13 2022] GET /identity/v3/endpoints?service_id=2a557ae65b2d408089aa5fc69868cab6&interface=public®ion_id=RegionOne => generated 194 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:14.156901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:14.226801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87d74f-c871-495f-be87-6693f6f244ab None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:14.288769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:14.289764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.290232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.290717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.292291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:14.296006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:14.297666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:14.315727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 402/783] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:14.325600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:14.354723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a373be-19f9-46b1-9845-c5bc5b1d9698 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:14.382227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:14.430943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457487-b77f-4d46-84a2-fe661a408356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:14.432207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457487-b77f-4d46-84a2-fe661a408356 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.433267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457487-b77f-4d46-84a2-fe661a408356 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.433789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457487-b77f-4d46-84a2-fe661a408356 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.434595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457487-b77f-4d46-84a2-fe661a408356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:14.437875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457487-b77f-4d46-84a2-fe661a408356 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:14.449980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 382/784] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:14 2022] GET /identity/v3/services => generated 772 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:14.468013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edf545-b12c-4262-9931-827cf97758a6 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:14.512525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251fc51-2fe3-4db0-bf99-9e22bfbeaac4 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.512852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251fc51-2fe3-4db0-bf99-9e22bfbeaac4 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.513077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251fc51-2fe3-4db0-bf99-9e22bfbeaac4 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.514810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 383/785] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:14.520581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ff18-f605-4743-97a0-d031ae3f18e6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.521224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ff18-f605-4743-97a0-d031ae3f18e6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.521224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8ff18-f605-4743-97a0-d031ae3f18e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.529787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:14.530900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.531402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.531890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.542164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-bdb8ff18-f605-4743-97a0-d031ae3f18e6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:14.543330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bdb8ff18-f605-4743-97a0-d031ae3f18e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:14.553565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:14.555589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:14.579807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:14.580828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:14.581739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:14.582659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:14.582659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:14.582659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:14.592904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 403/786] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:14.598985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:14.620950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 384/787] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:14.737844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:14.740640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb2021-4cde-4495-b5e1-63ff65637473 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:14.781482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:14.782378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.782789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.783203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.784001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:14.784428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:14.785947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:14.799282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 404/788] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:14.804710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ff18-f605-4743-97a0-d031ae3f18e6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:14.921986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8ff18-f605-4743-97a0-d031ae3f18e6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:14.968768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:14.969703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:14.970116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:14.970515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:14.979179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:14.980670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:14.998350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:14.999282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:15.000231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:15.003872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 385/789] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:15.005170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.042825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.108716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:15.163541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1e025-4bf3-40ff-8247-1e4748039209 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:15.222186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9ee61-e80e-4c17-8177-ac69e5d22690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:15.223062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5123ba-2732-4ac4-b955-2299fb2a74b2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:15.223395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ee61-e80e-4c17-8177-ac69e5d22690 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.223948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ee61-e80e-4c17-8177-ac69e5d22690 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.224638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ee61-e80e-4c17-8177-ac69e5d22690 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.226525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9ee61-e80e-4c17-8177-ac69e5d22690 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:15.227022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9ee61-e80e-4c17-8177-ac69e5d22690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:15.228844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9ee61-e80e-4c17-8177-ac69e5d22690 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:15.250464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 405/790] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:15.256423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c74b86-0942-48ff-93a3-88663fcc50a3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.256704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c74b86-0942-48ff-93a3-88663fcc50a3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.256971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c74b86-0942-48ff-93a3-88663fcc50a3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.263057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 406/791] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:15.263057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c74b86-0942-48ff-93a3-88663fcc50a3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.268554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa10a8-cfff-4434-98ff-043a89560d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:15.269504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa10a8-cfff-4434-98ff-043a89560d5a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.270034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa10a8-cfff-4434-98ff-043a89560d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.270484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa10a8-cfff-4434-98ff-043a89560d5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.278621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:15.283797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa10a8-cfff-4434-98ff-043a89560d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-9faa10a8-cfff-4434-98ff-043a89560d5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:15.289719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:15.290633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:15.291969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:15.299180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 386/792] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:15.300930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298eae-9c98-4628-9fb0-db300a308cf9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.301431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298eae-9c98-4628-9fb0-db300a308cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.301884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298eae-9c98-4628-9fb0-db300a308cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.321617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d6298eae-9c98-4628-9fb0-db300a308cf9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:15.323555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d6298eae-9c98-4628-9fb0-db300a308cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:15.374074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c74b86-0942-48ff-93a3-88663fcc50a3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:15.400036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 387/793] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:15.401556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6298eae-9c98-4628-9fb0-db300a308cf9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.419239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:15.419239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.419239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.419239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.428871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:15.428871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:15.444565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:15.445561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:15.446434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:15.446434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:15.446434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:15.446434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 407/794] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:15.451589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.461125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:15.547867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:15.614700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3fdef-7bfe-4942-a230-5ee57fa2a2db None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:15.644328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6298eae-9c98-4628-9fb0-db300a308cf9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:15.687405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:15.688395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.688868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.689362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.690224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:15.692278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:15.693931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:15.707546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:15.708608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.709084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.709550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.710406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:15.710916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:15.712513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:15.713687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 408/795] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:15.719593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.723092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 388/796] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:15.725077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.823397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:15.826312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945953a-2ca0-4636-aa30-38d77d1ef48c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:15.845083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c6f5e-ec46-4dc1-b4ca-7e4eed1ed2f2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:15.855901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:15.862907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:15.863921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.864436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.864880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.876461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:15.881542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:15.882480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:15.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:15.886011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 409/797] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:15.886199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:15.886916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:15.887190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:15.887450 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:15.887957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:15.895730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:15.897184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:15.917756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:15.918754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:15.919661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:15.923780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 389/798] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:15.925791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.000675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b0bea-03ea-4043-a1f3-954e8a9b1faf None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.035214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.035927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.036212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.036540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.046942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.048438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.054042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7b847-8ed2-4c11-bd44-e537379551ac None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:16.064073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:16.065233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:16.066131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:16.066131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:16.066131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:16.066131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 410/799] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:16.067120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.096082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.097050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.097515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.097979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.098977 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:16.099793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.101634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.110988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 390/800] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:16.112130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.115199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:16.115799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:16.192304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a89e9-846c-4902-a950-ae4c6253c1cd None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.230147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc00942-8ef2-4211-adbe-e7d99aea3a8b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.245381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.246489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.246987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.247747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.249271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:16.250078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.252498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.271902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.272495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.272779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.273094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.273849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:16.274148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.275945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.281512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 411/801] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:16.281512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.297864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 391/802] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:16.298786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.370391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:16.402455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e0ab-77df-4fac-8528-e3036991cde9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.404033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:16.418092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aa78f-579f-4189-bc17-cf4863fe4ed6 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.446778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.447527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.447826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.448090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.456054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f93b9-3018-471b-8aa2-cc40241871f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.456980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f93b9-3018-471b-8aa2-cc40241871f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.457436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f93b9-3018-471b-8aa2-cc40241871f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.457887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f93b9-3018-471b-8aa2-cc40241871f8 None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/75b6057e2fd7438cb3fa2a0ec2933fcc/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.458442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.459919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.460385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f93b9-3018-471b-8aa2-cc40241871f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=75b6057e2fd7438cb3fa2a0ec2933fcc, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.462193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f93b9-3018-471b-8aa2-cc40241871f8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:16.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:16.477292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:16.478211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:16.478211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:16.478211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:16.478211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 412/803] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:16.478211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.480213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 392/804] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:46:16 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/75b6057e2fd7438cb3fa2a0ec2933fcc/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:46:16.481808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb1c62-5d05-46f9-bdae-87365ea1f075 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.482273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb1c62-5d05-46f9-bdae-87365ea1f075 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.482670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb1c62-5d05-46f9-bdae-87365ea1f075 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.484830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 393/805] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:16.485855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb1c62-5d05-46f9-bdae-87365ea1f075 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.600254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b31d02-c0c8-462f-86ed-2fe1ec1e656d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.609158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb1c62-5d05-46f9-bdae-87365ea1f075 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.638641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:16.639085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.639975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.640458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.640900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.650183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.650473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b2b22-6e1e-4833-a6e5-3215b6663332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.651043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b2b22-6e1e-4833-a6e5-3215b6663332 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.651632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b2b22-6e1e-4833-a6e5-3215b6663332 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.652007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b2b22-6e1e-4833-a6e5-3215b6663332 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.652730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b2b22-6e1e-4833-a6e5-3215b6663332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:16.653096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b2b22-6e1e-4833-a6e5-3215b6663332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.653528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.654789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b2b22-6e1e-4833-a6e5-3215b6663332 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:16.666770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:16.667991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:16.668910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:16.675734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 394/806] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:16.675734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfc31a-b3b2-4459-aaad-ce0a1bdfe531 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.675734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfc31a-b3b2-4459-aaad-ce0a1bdfe531 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.676106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfc31a-b3b2-4459-aaad-ce0a1bdfe531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.676525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 413/807] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:16.677600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.695901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:16.697538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-33dfc31a-b3b2-4459-aaad-ce0a1bdfe531 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:16.698773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-33dfc31a-b3b2-4459-aaad-ce0a1bdfe531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:16.772303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 395/808] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:16.773540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfc31a-b3b2-4459-aaad-ce0a1bdfe531 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.817283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c32008-e033-414a-afff-a22e58b407a5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.861999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.861999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.861999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.861999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] PATH_INFO: `/v3/users/nova` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.871161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.872647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:16.888346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:16.889370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:16.890394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 414/809] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:16.897608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:16.940573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfc31a-b3b2-4459-aaad-ce0a1bdfe531 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:16.954939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:16.977935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9860d-dd97-4a55-bacb-7003b7cd37d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:16.978900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9860d-dd97-4a55-bacb-7003b7cd37d9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:16.979172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9860d-dd97-4a55-bacb-7003b7cd37d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:16.979435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9860d-dd97-4a55-bacb-7003b7cd37d9 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:16.980203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9860d-dd97-4a55-bacb-7003b7cd37d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:16.980554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9860d-dd97-4a55-bacb-7003b7cd37d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:16.981973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9860d-dd97-4a55-bacb-7003b7cd37d9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.003738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 396/810] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:17.003738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2868a-1a50-416c-9fe4-9c4067f0209e None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.003738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2868a-1a50-416c-9fe4-9c4067f0209e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.003738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2868a-1a50-416c-9fe4-9c4067f0209e None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.003738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 397/811] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:17.011717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2868a-1a50-416c-9fe4-9c4067f0209e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.021342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:17.053112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7401dac-353b-42fe-bd00-44ac13e4cfde None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.096165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4e6b8-d526-4ca7-88a2-f934a1589678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.097322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4e6b8-d526-4ca7-88a2-f934a1589678 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.097787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4e6b8-d526-4ca7-88a2-f934a1589678 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.098267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4e6b8-d526-4ca7-88a2-f934a1589678 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.099423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4e6b8-d526-4ca7-88a2-f934a1589678 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:17.099835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4e6b8-d526-4ca7-88a2-f934a1589678 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.101441 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4e6b8-d526-4ca7-88a2-f934a1589678 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.122593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 415/812] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:46:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:17.123504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a912-0890-4efb-8b2a-8ccbcdcbf1da None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.123806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a912-0890-4efb-8b2a-8ccbcdcbf1da None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.124077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a912-0890-4efb-8b2a-8ccbcdcbf1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.125797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2868a-1a50-416c-9fe4-9c4067f0209e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.144805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6d85a912-0890-4efb-8b2a-8ccbcdcbf1da None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:17.145896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6d85a912-0890-4efb-8b2a-8ccbcdcbf1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:17.168418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.169693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.170354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.170770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.182246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.183674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:17.197974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:17.198907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:17.200675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:17.200675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:17.200675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:17.200675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 398/813] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:17.204319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.224001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 416/814] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:17.224001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85a912-0890-4efb-8b2a-8ccbcdcbf1da None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.238720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:17.293092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:17.334454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85a912-0890-4efb-8b2a-8ccbcdcbf1da None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.338069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0dce0-410d-4826-8f9e-89e98c92d351 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.373999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.374985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.375461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.375939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] PATH_INFO: `/v3/services/network` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.376700 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.378338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.379190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.379903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.380241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.380568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:17.388773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:17.389779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:46:17.390624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:17.393507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 399/815] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:17.394604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.469029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.471339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.507018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:17.524208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bce88-3143-44d0-8b4d-b12c821a8344 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.535835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:17.560732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.561351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.561631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.561901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.562536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:17.562835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.564343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.580862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 400/816] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:17.581038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 417/817] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:17.581122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.581193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.683179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6253d6-a35b-4682-80ce-d0b20977464f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.683382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e8fa-24b7-4c57-92d9-588c27cd435b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.719346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.719958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.720379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.720485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.720575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.720970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.721067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.721246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.721512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.722129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] RBAC: Adding query filter params (name=network) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:17.722419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.722523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.723788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.733536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 401/818] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:17.733536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:17.733779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:17.735034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:46:17.736489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:17.738378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 418/819] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:17.738923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.747318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:17.767512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:17.842172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9075919-631d-4997-88d4-1a94f281c959 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.847047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bd235-427b-44b3-960f-0e2eec9e55fa None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:17.878776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.879413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.879691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.879980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.885973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:17.886713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:17.887086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:17.887445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:17.887912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.889571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.898765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:17.900418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:17.901418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:17.902447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 402/820] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:17.903585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:17.920951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:17.921940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:17.922838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:17.922838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:17.922838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:17.922838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 419/821] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:17.923848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:17.983934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:18.002755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:18.017077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa7d6-bb96-4fae-8cbf-6c5c5d48a087 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.025630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2e9bc-33ed-45e1-a66b-09a793110edb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.052335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.053137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.053514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.053845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.054589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] RBAC: Adding query filter params (type=network) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:18.054956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.056506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.060890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.061543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.061794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.062056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.062721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 403/822] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:18.063849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.064132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:18.064702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.066092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.071881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 420/823] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Sep 15 12:46:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:18.072758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.171378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7441863-c681-4afd-a7c9-6354baaf0530 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.177603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff7c09-e294-47bd-bf73-09bdc8824782 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.209383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.210000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.210277 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.210585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.211228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:18.211532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.211751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.212351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.212661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.213008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.213200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.213665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:18.213848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.214904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:18.215205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.232802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 404/824] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:18.234964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.346436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 421/825] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:18.347268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.350035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131ccf-ed90-44cb-a37a-25c26ed79e0f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.351327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:18.390254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.390875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.391143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.391417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.392128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.393501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.420215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 405/826] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:18.421155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.491362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:18.511189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574ca0-5126-424c-8b4c-9269cf0e7370 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.556237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.557311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.557702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.557974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.558621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:18.558915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.561277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.573129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 422/827] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Sep 15 12:46:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:18.573129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.578892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b152-913d-4051-ac19-6d5e69e35dc3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.629563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.630488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.630622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.630851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/b2684f91284d49fc98b4caaace8cbba4/roles/18adaf361b7749e69eabe75f61459b46` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.654267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=b2684f91284d49fc98b4caaace8cbba4, role_id=18adaf361b7749e69eabe75f61459b46)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.655398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.659018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:18.679626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 406/828] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:46:18 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/b2684f91284d49fc98b4caaace8cbba4/roles/18adaf361b7749e69eabe75f61459b46 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:46:18.680881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.733411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36d173-e60e-49f5-881a-77d67576d50e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.777430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea3b29-570c-4db1-bd74-8533c515bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.778070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea3b29-570c-4db1-bd74-8533c515bfaa None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.778280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea3b29-570c-4db1-bd74-8533c515bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.778533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea3b29-570c-4db1-bd74-8533c515bfaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.786559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea3b29-570c-4db1-bd74-8533c515bfaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.788089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea3b29-570c-4db1-bd74-8533c515bfaa None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-6dea3b29-570c-4db1-bd74-8533c515bfaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:18.800932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:18.801935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:18.802802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 423/829] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:18.803861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302af4a-d196-4228-a338-4fa8cd8e617e None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.803861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302af4a-d196-4228-a338-4fa8cd8e617e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.804047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302af4a-d196-4228-a338-4fa8cd8e617e None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.805382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 424/830] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:18.808661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302af4a-d196-4228-a338-4fa8cd8e617e None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:18.824335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:18.827950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a803-47c2-438c-bafd-20c2e12df897 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.870354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8fdf9-71fc-479b-b53a-aa9115db82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:18.870991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8fdf9-71fc-479b-b53a-aa9115db82b0 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.871273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8fdf9-71fc-479b-b53a-aa9115db82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.871543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8fdf9-71fc-479b-b53a-aa9115db82b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.872266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8fdf9-71fc-479b-b53a-aa9115db82b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:18.873659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8fdf9-71fc-479b-b53a-aa9115db82b0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:18.898900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 407/831] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:18.900392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53336e61-efe8-4264-bd4a-498810c6c175 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:18.900678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53336e61-efe8-4264-bd4a-498810c6c175 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:18.900950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53336e61-efe8-4264-bd4a-498810c6c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:18.922214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-53336e61-efe8-4264-bd4a-498810c6c175 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:18.923454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-53336e61-efe8-4264-bd4a-498810c6c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:18.950722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302af4a-d196-4228-a338-4fa8cd8e617e None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:18.976689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:19.001790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:19.003068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:19.003530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:19.004275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:19.005730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:19.006508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:19.008451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:19.015896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 408/832] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:19.022367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 425/833] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:19.028353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53336e61-efe8-4264-bd4a-498810c6c175 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:19.122853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:19.140682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53336e61-efe8-4264-bd4a-498810c6c175 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:19.176076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:19.176692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:19.176965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:19.177232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:19.177957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=ac2cabfcf8224f70a3129dc308e67b4f) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:19.178257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:19.179776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:19.186467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 409/834] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:19 2022] GET /identity/v3/role_assignments?user.id=ac2cabfcf8224f70a3129dc308e67b4f&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:19.285716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:19.396161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe201f-278d-4f1e-8bc6-2fb90498968d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:19.435439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:19.436351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:19.436806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:19.437252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:19.452953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:19.459193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:19.460397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:19.461443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:19.463445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 426/835] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:19.469598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:19.577022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2790-c45f-43fe-b616-00b07fa3d994 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:19.611639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:19.612272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:19.612544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:19.612805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:19.613456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:19.613748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:19.615100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:19.623889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 410/836] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:19.629767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:19.674767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:19.743537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de784c4-706a-4c9c-9ec6-8b6bf122b171 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:19.779337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:19.780084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:19.780417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:19.780736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:19.792148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:19.793679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:19.808384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:19.809550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:19.810658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:19.810658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:19.810658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:19.812102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 427/837] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:19.817247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:19.838396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:19.924389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813edb2-f093-4b0a-8a40-f2392adcf533 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:19.960208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:19.960826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:19.961101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:19.961371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:19.962008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:19.962302 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:19.963963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:19.976550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 411/838] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:19.982278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:20.082379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:20.092319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026a5d7-04c1-4662-8141-332f73c345c4 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:20.127105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:20.127750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:20.128027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:20.128292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:20.135943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:20.137376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:20.148584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:20.149681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:20.150923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 428/839] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:20.157633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:20.232295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:20.266137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e950a9d-b7ca-4f5f-884f-6cfa3e20483f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:20.300744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:20.301360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:20.301635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:20.301904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:20.302626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:20.302924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:20.304389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:20.322931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 412/840] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Sep 15 12:46:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:20.328896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:20.439014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09f435-56e2-421c-b939-55f423a9171b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:20.472547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:20.473157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:20.473426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:20.473685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:20.493376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:20.544692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:20.546212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:20.648198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 429/841] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:20.654373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:20.755690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aacfc4-f0d2-4a04-bc1f-213ac73d2701 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:20.785291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:20.793224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9325d-5b7f-46c5-bff5-5a96df9140a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:20.794137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9325d-5b7f-46c5-bff5-5a96df9140a8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:20.794648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9325d-5b7f-46c5-bff5-5a96df9140a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:20.795110 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9325d-5b7f-46c5-bff5-5a96df9140a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:20.806512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9325d-5b7f-46c5-bff5-5a96df9140a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:20.808507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9325d-5b7f-46c5-bff5-5a96df9140a8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-4cd9325d-5b7f-46c5-bff5-5a96df9140a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:20.826009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:20.827034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:20.827969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:20.827969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:20.827969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:20.834882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 413/842] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:20.836915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:20.891565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:20.938463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33db3bd-febe-43c5-bf50-e12a0c49da08 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:20.938987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33db3bd-febe-43c5-bf50-e12a0c49da08 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:20.938987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33db3bd-febe-43c5-bf50-e12a0c49da08 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:20.940693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 414/843] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:20.948019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd63327-2860-49fd-b424-31d90aed4f9e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:20.948556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd63327-2860-49fd-b424-31d90aed4f9e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:20.949035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd63327-2860-49fd-b424-31d90aed4f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:20.951572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c93d9-323a-40e2-a1c6-36acddf62eb7 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:20.968670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-bcd63327-2860-49fd-b424-31d90aed4f9e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:20.969923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bcd63327-2860-49fd-b424-31d90aed4f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:20.996294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:20.997534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:20.998143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:20.998607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:20.999924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:21.000485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:21.002461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:21.016760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 430/844] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:21.022554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.049216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 415/845] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:21.130106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2ba76-2ac5-47bd-918a-6a53abe1002b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:21.141463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:21.169719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34839046-e04b-49c3-9365-b9c37e3b1e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:21.170709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34839046-e04b-49c3-9365-b9c37e3b1e39 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.171160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34839046-e04b-49c3-9365-b9c37e3b1e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.171602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34839046-e04b-49c3-9365-b9c37e3b1e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.180196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34839046-e04b-49c3-9365-b9c37e3b1e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:21.183337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34839046-e04b-49c3-9365-b9c37e3b1e39 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-34839046-e04b-49c3-9365-b9c37e3b1e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:21.198798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:21.199775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:21.200677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:21.202671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 431/846] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:21.208866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd63327-2860-49fd-b424-31d90aed4f9e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.273037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811cf5-fa6e-4ca9-9958-9f191a24e33d None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.273603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811cf5-fa6e-4ca9-9958-9f191a24e33d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.274086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811cf5-fa6e-4ca9-9958-9f191a24e33d None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.275929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 432/847] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:21.281134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d0183-013c-4d80-bf8f-1b2bf6496304 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.281641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d0183-013c-4d80-bf8f-1b2bf6496304 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.282120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d0183-013c-4d80-bf8f-1b2bf6496304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.305638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-628d0183-013c-4d80-bf8f-1b2bf6496304 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:21.307933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-628d0183-013c-4d80-bf8f-1b2bf6496304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:21.315367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd63327-2860-49fd-b424-31d90aed4f9e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:21.329945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:21.353422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:21.354101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.354380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.354647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.355342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:21.355660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:21.357141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:21.369415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 416/848] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:21.371874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.384842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 433/849] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:21.385897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d0183-013c-4d80-bf8f-1b2bf6496304 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.506405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5dcec-8805-449b-9ac7-d85d98846c1d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:21.524834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:21.531085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d0183-013c-4d80-bf8f-1b2bf6496304 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:21.549139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b4dab-0c8c-4fc5-a693-ec9ceaa9f6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:21.550495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b4dab-0c8c-4fc5-a693-ec9ceaa9f6ad None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.550993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b4dab-0c8c-4fc5-a693-ec9ceaa9f6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.551471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b4dab-0c8c-4fc5-a693-ec9ceaa9f6ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.566606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b4dab-0c8c-4fc5-a693-ec9ceaa9f6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:21.567169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:21.567820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.568092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.568355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.569073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=75b6057e2fd7438cb3fa2a0ec2933fcc) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:21.569373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:21.570822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-825b4dab-0c8c-4fc5-a693-ec9ceaa9f6ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:21.574749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:21.575685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:21.576563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 417/850] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:21.577234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 434/851] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/role_assignments?user.id=75b6057e2fd7438cb3fa2a0ec2933fcc&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:21.577643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724e21-f0c4-417f-8563-b53260d23d6e None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.577894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724e21-f0c4-417f-8563-b53260d23d6e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.578114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724e21-f0c4-417f-8563-b53260d23d6e None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.579320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 418/852] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:21.585396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.585676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1a77-ea46-4fe3-8897-172c69260ad3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.585676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1a77-ea46-4fe3-8897-172c69260ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.585676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e1a77-ea46-4fe3-8897-172c69260ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.610839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f87e1a77-ea46-4fe3-8897-172c69260ad3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:21.612512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f87e1a77-ea46-4fe3-8897-172c69260ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:21.650761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:21.699354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 419/853] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:21.700280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1a77-ea46-4fe3-8897-172c69260ad3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.711686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73c336-b5d4-41f0-b86b-f972fa7394f5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:21.752671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:21.753774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.754322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.754855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.755855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:21.756346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:21.758021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:21.768671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 435/854] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:21.773996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.807856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:21.826593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e1a77-ea46-4fe3-8897-172c69260ad3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:21.869869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:21.870936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.871416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.871919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.872704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:21.874274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:21.883745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:21.884760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:21.885618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:21.888351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 420/855] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:21.894556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:21.908746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20af7f-f9ec-4624-b4e8-cc0ebf43e4a8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:21.925293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:21.948493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:21.949133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:21.949409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:21.949674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:21.961124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:21.962608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:21.977723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:21.978832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:21.979761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:21.979761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:21.979761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:21.982536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 436/856] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:21.983863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.004245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbf50b-883f-45f3-b179-8648156303c9 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.038872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.039934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.040219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.040783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.041411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:22.041712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.043084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.053055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 421/857] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:22.053055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.070747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:22.093875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24643ae-f57f-4854-9bd5-714254e4519f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.129470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.130112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.130388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.130654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.131231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.132643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:22.141663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:22.142625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:22.143505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 437/858] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Sep 15 12:46:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:22.144337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.161392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:22.174184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a72347-f3d6-4c6c-ba55-97e8b7b0b2a4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.212097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.212995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.213448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.213719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.214363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:22.214661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.216066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.229554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 422/859] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:22.230368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.260752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3d02-fa99-4b97-a644-2754efd5b695 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.298421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.299079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.299296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.299562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.300220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:22.300515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.301893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.306778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 438/860] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:22.307355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.317353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:22.377082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53eb7d-46e1-4605-82e1-fd1f005208a2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.418559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.419186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.419461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.419765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.420412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:22.420775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.422226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.427544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 423/861] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:22.433641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.450613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad736b4-cfcb-45a0-b3d7-db0332c56b06 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.453993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:22.503167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.504879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.505166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.505431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.514145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.515592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:22.530403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:22.532127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:22.533331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 439/862] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:46:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:22.538403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.573557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed590a1-6d31-496c-b542-871322668902 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.606581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:22.620690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.622042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.622471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.622892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.624083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:22.624780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.626576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.633346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 424/863] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:22.654489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681e893-216b-4ccc-8055-c68b9ff73f39 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.694231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.695145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.695636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.696075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.697124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:22.697588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.699287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:22.720906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 440/864] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Sep 15 12:46:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:22.728657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:22.816514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:22.839830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd331fd-54ad-498a-b0cf-de5ee3beb3e6 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:22.881141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:22.881771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:22.882047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:22.882316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:22.954011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:22.955380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:23.034660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:23.057442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 425/865] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:23.063270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:23.164894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765f41-2d0a-4973-a65a-f86a59587150 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:23.188330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:23.199623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:23.200280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:23.200544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:23.200802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:23.210979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:23.212543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:23.226811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:23.227792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:23.228706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:23.228706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:23.228706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:23.228706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 441/866] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:23.233732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:23.335647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861a9b3-8406-4dbd-acc9-c7934cbcc7ea None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:23.370380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:23.371001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:23.371277 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:23.371540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:23.372211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:23.372509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:23.373873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:23.385902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 426/867] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:23.391406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:23.507719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc98eb-9305-4eca-88fb-ab73694599fa None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:23.543124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:23.544670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:23.545150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:23.545629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:23.553711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:23.555521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:23.567655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:23.568612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:23.569519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:23.572109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 442/868] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:23.583499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:23.624739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:23.685375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aeba89-a253-475f-95b0-5fc808779bfd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:23.719131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c696e2-879d-40e5-b17b-8a44d09dd6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:23.719770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c696e2-879d-40e5-b17b-8a44d09dd6dc None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:23.720046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c696e2-879d-40e5-b17b-8a44d09dd6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:23.720314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c696e2-879d-40e5-b17b-8a44d09dd6dc None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:23.721001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c696e2-879d-40e5-b17b-8a44d09dd6dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:23.721303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c696e2-879d-40e5-b17b-8a44d09dd6dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:23.722740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c696e2-879d-40e5-b17b-8a44d09dd6dc None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:23.740111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 427/869] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:23.744031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:23.780500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:23.850587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bf8ba-117e-4ffb-9b44-64ed6a760647 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:23.885201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ef0ef-cc4e-4d45-bce6-2a6e714be5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:23.885817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ef0ef-cc4e-4d45-bce6-2a6e714be5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:23.886148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ef0ef-cc4e-4d45-bce6-2a6e714be5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:23.886417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ef0ef-cc4e-4d45-bce6-2a6e714be5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:23.887143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ef0ef-cc4e-4d45-bce6-2a6e714be5e8 None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=b2684f91284d49fc98b4caaace8cbba4) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:23.887442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ef0ef-cc4e-4d45-bce6-2a6e714be5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:23.888906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ef0ef-cc4e-4d45-bce6-2a6e714be5e8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:23.895064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 443/870] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:23 2022] GET /identity/v3/role_assignments?user.id=b2684f91284d49fc98b4caaace8cbba4&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:23.943412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b768-4b7d-48e4-9966-a43758192a46 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:23.943785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b768-4b7d-48e4-9966-a43758192a46 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:23.943975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b768-4b7d-48e4-9966-a43758192a46 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:23.945488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 428/871] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:23.951416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851ca22-d8cd-45b3-89f0-7bd0c64add08 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:23.951794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851ca22-d8cd-45b3-89f0-7bd0c64add08 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:23.951997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851ca22-d8cd-45b3-89f0-7bd0c64add08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:23.971956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4851ca22-d8cd-45b3-89f0-7bd0c64add08 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:23.973202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4851ca22-d8cd-45b3-89f0-7bd0c64add08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:24.051949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 444/872] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:24.314657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b768-4b7d-48e4-9966-a43758192a46 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:24.416771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:24.421239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b768-4b7d-48e4-9966-a43758192a46 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:24.457499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab1ba4-b109-42b4-91fe-3e4f117d6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:24.458163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1ba4-b109-42b4-91fe-3e4f117d6d14 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:24.458443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1ba4-b109-42b4-91fe-3e4f117d6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:24.458715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1ba4-b109-42b4-91fe-3e4f117d6d14 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:24.459311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab1ba4-b109-42b4-91fe-3e4f117d6d14 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:24.461014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab1ba4-b109-42b4-91fe-3e4f117d6d14 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-1bab1ba4-b109-42b4-91fe-3e4f117d6d14 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:24.471579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:24.472754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:24.473659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 429/873] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:24.481223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851ca22-d8cd-45b3-89f0-7bd0c64add08 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:24.516018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:24.586595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851ca22-d8cd-45b3-89f0-7bd0c64add08 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:24.590492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a557-b522-40b0-b79e-9bd36fd7c05c None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:24.590779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a557-b522-40b0-b79e-9bd36fd7c05c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:24.591051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a557-b522-40b0-b79e-9bd36fd7c05c None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:24.592751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 430/874] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:24.600869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904fd28-2c01-4802-8577-9fdb1c37115c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:24.601424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904fd28-2c01-4802-8577-9fdb1c37115c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:24.601915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904fd28-2c01-4802-8577-9fdb1c37115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:24.623081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e904fd28-2c01-4802-8577-9fdb1c37115c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:24.624687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e904fd28-2c01-4802-8577-9fdb1c37115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:24.630490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:24.631157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:24.631436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:24.631723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:24.632393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:24.632690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:24.634094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:24.640780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 445/875] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:24.646260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:24.709326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 431/876] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:24.759742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:24.766752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36326-06cb-4644-b80d-2252ddc72dee None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:24.804394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680168d-cb4b-4123-895d-a939ff96b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:24.805378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680168d-cb4b-4123-895d-a939ff96b222 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:24.805843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680168d-cb4b-4123-895d-a939ff96b222 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:24.806367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680168d-cb4b-4123-895d-a939ff96b222 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:24.807172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680168d-cb4b-4123-895d-a939ff96b222 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:24.807631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680168d-cb4b-4123-895d-a939ff96b222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:24.809227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680168d-cb4b-4123-895d-a939ff96b222 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:24.815234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 446/877] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:24.920053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da250609-dbd9-4b29-b95a-3cdaaafb26f6 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:24.920634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da250609-dbd9-4b29-b95a-3cdaaafb26f6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:24.921117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da250609-dbd9-4b29-b95a-3cdaaafb26f6 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:24.922989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 432/878] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:24.928978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd19c-ea47-49f1-be74-97b9d67b7939 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:24.929609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd19c-ea47-49f1-be74-97b9d67b7939 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:24.930090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfd19c-ea47-49f1-be74-97b9d67b7939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:24.950104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3edfd19c-ea47-49f1-be74-97b9d67b7939 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:24.951875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3edfd19c-ea47-49f1-be74-97b9d67b7939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:24.996558 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da250609-dbd9-4b29-b95a-3cdaaafb26f6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:25.031887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 447/879] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:25.100962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:25.110867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da250609-dbd9-4b29-b95a-3cdaaafb26f6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:25.146132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d319e3-2fcb-49af-97fe-01b6b7b89068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:25.146738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d319e3-2fcb-49af-97fe-01b6b7b89068 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:25.147008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d319e3-2fcb-49af-97fe-01b6b7b89068 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:25.147269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d319e3-2fcb-49af-97fe-01b6b7b89068 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:25.147931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d319e3-2fcb-49af-97fe-01b6b7b89068 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:25.149298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d319e3-2fcb-49af-97fe-01b6b7b89068 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:25.165670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 433/880] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:24 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:46:25.311344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfd19c-ea47-49f1-be74-97b9d67b7939 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:25.408875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:25.423129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfd19c-ea47-49f1-be74-97b9d67b7939 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:25.468231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f9b06-ac75-4af4-b5bb-f1f498051763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:25.468899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f9b06-ac75-4af4-b5bb-f1f498051763 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:25.469171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f9b06-ac75-4af4-b5bb-f1f498051763 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:25.469478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f9b06-ac75-4af4-b5bb-f1f498051763 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:25.470124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f9b06-ac75-4af4-b5bb-f1f498051763 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:25.471487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f9b06-ac75-4af4-b5bb-f1f498051763 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:25.491761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 448/881] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:25 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:26.225714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a587-b747-416e-957a-0a3af585ff00 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:26.226275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a587-b747-416e-957a-0a3af585ff00 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:26.226275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a587-b747-416e-957a-0a3af585ff00 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:26.228013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 434/882] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:26.233329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade123f9-4d7d-44b8-8d6d-4356dfc25cc2 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:26.233773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade123f9-4d7d-44b8-8d6d-4356dfc25cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:26.234201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade123f9-4d7d-44b8-8d6d-4356dfc25cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:26.252862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-ade123f9-4d7d-44b8-8d6d-4356dfc25cc2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:26.254102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ade123f9-4d7d-44b8-8d6d-4356dfc25cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:26.329654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 449/883] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:26.602881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a587-b747-416e-957a-0a3af585ff00 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:26.711774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a587-b747-416e-957a-0a3af585ff00 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:26.746701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:26.749427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:26.749427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:26.749427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:26.762298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:26.763613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:26.764559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:26.765415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 435/884] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Sep 15 12:46:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:26.774336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade123f9-4d7d-44b8-8d6d-4356dfc25cc2 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:26.843737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:26.876795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade123f9-4d7d-44b8-8d6d-4356dfc25cc2 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:26.912050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b249959-8235-4dd5-bcc3-a75dc18c61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:26.913198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b249959-8235-4dd5-bcc3-a75dc18c61bd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:26.913746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b249959-8235-4dd5-bcc3-a75dc18c61bd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:26.914210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b249959-8235-4dd5-bcc3-a75dc18c61bd None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:26.915095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b249959-8235-4dd5-bcc3-a75dc18c61bd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:26.915739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b249959-8235-4dd5-bcc3-a75dc18c61bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:26.917338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b249959-8235-4dd5-bcc3-a75dc18c61bd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:26.926523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 450/885] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Sep 15 12:46:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:26.934395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:26.951266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:27.043640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9c80c-7910-47c9-b326-3365f055114e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:27.079198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:27.079873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.080143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.080406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.091446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:27.092039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147370-4df5-4508-b5ea-9813efe3dc83 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.092689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147370-4df5-4508-b5ea-9813efe3dc83 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.092924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:27.093364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147370-4df5-4508-b5ea-9813efe3dc83 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.095162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 451/886] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:27.100593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb396-4b1f-4020-89f8-a6a9825af4a7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.101123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb396-4b1f-4020-89f8-a6a9825af4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.101607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cb396-4b1f-4020-89f8-a6a9825af4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:27.108479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:27.109903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:27.110794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:27.110794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:27.110794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:27.110794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 436/887] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:27.116698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:27.130199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4a1cb396-4b1f-4020-89f8-a6a9825af4a7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:27.131578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4a1cb396-4b1f-4020-89f8-a6a9825af4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:27.207722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 452/888] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:27.207922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:27.234385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02796-b458-49bb-860d-9eb9b581ca5a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:27.270428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e6f6-c229-4aab-966a-744d55772886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:27.271040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e6f6-c229-4aab-966a-744d55772886 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.271312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e6f6-c229-4aab-966a-744d55772886 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.271577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e6f6-c229-4aab-966a-744d55772886 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.272240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e6f6-c229-4aab-966a-744d55772886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:27.272535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e6f6-c229-4aab-966a-744d55772886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:27.273899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e6f6-c229-4aab-966a-744d55772886 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:27.290479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 437/889] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:27.296454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cb396-4b1f-4020-89f8-a6a9825af4a7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:27.375393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:27.414875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cb396-4b1f-4020-89f8-a6a9825af4a7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:27.450194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:27.450836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.451111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.451378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.458642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:27.460199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:27.472047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400a64-dcc5-41bf-8926-de74265ba3e3 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.472347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400a64-dcc5-41bf-8926-de74265ba3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.472591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92400a64-dcc5-41bf-8926-de74265ba3e3 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:27.473705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:27.474621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:27.475572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:27.476160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 438/890] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:27.476229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 453/891] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:46:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:27.480715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d7df6-6906-42ea-9a68-c6ca0a2bf9e9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.480990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d7df6-6906-42ea-9a68-c6ca0a2bf9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.481251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d7df6-6906-42ea-9a68-c6ca0a2bf9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.484168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:27.500465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-560d7df6-6906-42ea-9a68-c6ca0a2bf9e9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:27.501665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-560d7df6-6906-42ea-9a68-c6ca0a2bf9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:27.574225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 439/892] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:27.575052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d7df6-6906-42ea-9a68-c6ca0a2bf9e9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:27.591609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604d454-47b5-4ede-be24-4d8030f7be89 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:27.622163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:27.639226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:27.640458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.642152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.642402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.643177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:27.643484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:27.645036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:27.659475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:27.671036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 454/893] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Sep 15 12:46:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:27.672163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:27.715023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d7df6-6906-42ea-9a68-c6ca0a2bf9e9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:27.751917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c11419-d760-4669-911f-ee20ba9ca973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:27.752593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c11419-d760-4669-911f-ee20ba9ca973 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.752875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c11419-d760-4669-911f-ee20ba9ca973 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.753144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c11419-d760-4669-911f-ee20ba9ca973 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.753798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c11419-d760-4669-911f-ee20ba9ca973 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:27.755191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c11419-d760-4669-911f-ee20ba9ca973 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:27.772552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 440/894] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:27 2022] POST /identity/v3/services => generated 241 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:27.778665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396432fd-49b3-49fd-8fc3-fd6b477a7361 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:27.781235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74282dfb-0d70-4815-95a7-53a6c9f6fedd None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.781522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74282dfb-0d70-4815-95a7-53a6c9f6fedd None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.781808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74282dfb-0d70-4815-95a7-53a6c9f6fedd None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.783437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 441/895] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:27.789119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bfa05-ba0c-4f91-9c81-5feb2dc311a2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.789428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bfa05-ba0c-4f91-9c81-5feb2dc311a2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.789675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bfa05-ba0c-4f91-9c81-5feb2dc311a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.820176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-361bfa05-ba0c-4f91-9c81-5feb2dc311a2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:27.822814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-361bfa05-ba0c-4f91-9c81-5feb2dc311a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:27.832345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:27.833540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:27.834053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:27.834506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:27.888579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:27.912219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 442/896] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:27.912219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bfa05-ba0c-4f91-9c81-5feb2dc311a2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:27.915961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:27.917545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:27.977151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.038501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 455/897] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:46:28.042717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bfa05-ba0c-4f91-9c81-5feb2dc311a2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.045109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.084380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.085024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.085297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.085562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.086138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.088813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:28.099199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:28.100280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:28.101096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 443/898] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:28.108442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.134212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.160706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde2ad-2eab-4173-959d-1e0161f82b31 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.198695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.199504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.199808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.200072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.210288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.211780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.215562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846fd01-704b-433c-af6d-eb21a997a434 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.224994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:28.227714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:28.228781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:28.229711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:28.229711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:28.229711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:28.229711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 456/899] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:28.230328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.259633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.260289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.260568 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.260833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.261459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:28.261997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.264083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.269927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 444/900] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:28.275933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.343547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a213f1-9034-4035-994b-dc441a237d6c None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.372820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.383422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.384134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.384994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.384994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.385338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.386443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4ed0d-0f58-460d-a13f-5f9553667008 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.386715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:28.395600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:28.396569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:28.397455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 457/901] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:28.398256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.430259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.431012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.431386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.431860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.432397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:28.432596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.433958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.454031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 445/902] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:28.454031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.486104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.509297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73616dcb-8fae-4aff-bff5-5dbf629ba7bb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.543389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.544025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.544295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.544552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.545170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:28.545458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.546824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.551875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 458/903] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:28.552656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.573973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aec23-3aae-4ee3-b9a7-c2b401677ef0 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.611135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.614494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafca887-8f19-4139-b484-32196f33119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.615172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafca887-8f19-4139-b484-32196f33119b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.615471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafca887-8f19-4139-b484-32196f33119b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.615776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafca887-8f19-4139-b484-32196f33119b None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.616473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafca887-8f19-4139-b484-32196f33119b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:28.616768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafca887-8f19-4139-b484-32196f33119b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.618155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafca887-8f19-4139-b484-32196f33119b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.623077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 446/904] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:28.623892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafca887-8f19-4139-b484-32196f33119b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.660960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cd985-6dd5-4098-bc96-4e06c046c694 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.697233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.697869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.698141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.698399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.706855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.708374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:28.720868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:28.721817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 459/905] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:28.722700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.732207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.739640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafca887-8f19-4139-b484-32196f33119b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.776625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.777385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.777662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.777930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.778630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] RBAC: Adding query filter params (interface=public, service_id=d09cc84e486a4290870c6c71764d237c, region_id=RegionOne) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:28.778933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.780334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.785723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 447/906] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/endpoints?service_id=d09cc84e486a4290870c6c71764d237c&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:28.789177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.831135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc40fa9-296d-45f6-ab00-9be52e21dcad None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.849308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.868608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.869346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.869618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.870027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.870650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:28.870942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.872456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.882343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 460/907] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:28.883249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.892316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e7693-5483-4d42-9361-4ba3a065d819 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:28.926777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:28.927402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:28.927678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:28.927973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:28.928659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:28.928968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:28.930437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:28.944862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 448/908] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:28.945823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:28.973181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:28.992333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f1ea-ce55-479b-a796-28563b34b376 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:29.031030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:29.032038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:29.032557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:29.032889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:29.033706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:29.035091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:29.041688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 461/909] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:46:29.042623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:29.076267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64204-5e9d-48db-9e64-9cdb8dedc3b1 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:29.095823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:29.120887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:29.122016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:29.122500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:29.123079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:29.124046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] RBAC: Adding query filter params (interface=public, service_id=0fd7a407502c446d91707e3288bcc60c, region_id=RegionOne) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:29.124758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:29.127347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:29.134637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 449/910] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:46:28 2022] GET /identity/v3/endpoints?service_id=0fd7a407502c446d91707e3288bcc60c&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:29.143302 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:29.163595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4002-ad49-42dd-9470-ae4a91bce352 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:29.202202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e13ed1-fd90-4376-85da-4269da483f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:29.202886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13ed1-fd90-4376-85da-4269da483f73 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:29.203164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13ed1-fd90-4376-85da-4269da483f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:29.203425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13ed1-fd90-4376-85da-4269da483f73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:29.204291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13ed1-fd90-4376-85da-4269da483f73 None admin] RBAC: Adding query filter params (role.id=5339284d849f4b6f868fbb571a22b9e0, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=b2684f91284d49fc98b4caaace8cbba4) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:29.204590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13ed1-fd90-4376-85da-4269da483f73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:29.206194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13ed1-fd90-4376-85da-4269da483f73 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:29.220187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 462/911] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:29 2022] GET /identity/v3/role_assignments?user.id=b2684f91284d49fc98b4caaace8cbba4&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=5339284d849f4b6f868fbb571a22b9e0 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:29.236007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:29.256379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05371-a073-46cf-b437-fef225fb9f59 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:29.293813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10c35c-a37d-4938-8441-b9007f371c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:29.294446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10c35c-a37d-4938-8441-b9007f371c14 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:29.294695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10c35c-a37d-4938-8441-b9007f371c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:29.294951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10c35c-a37d-4938-8441-b9007f371c14 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:29.295554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10c35c-a37d-4938-8441-b9007f371c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:29.296957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10c35c-a37d-4938-8441-b9007f371c14 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:29.308030 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 450/912] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:29 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:46:29.989909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56d5ff-bacf-403a-bb29-421c0139bdeb None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:29.990975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56d5ff-bacf-403a-bb29-421c0139bdeb None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:29.991458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56d5ff-bacf-403a-bb29-421c0139bdeb None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:29.993524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 463/913] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:29.999447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628a2d-5b11-4473-b011-d21eb9e0b6ad None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:30.000060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628a2d-5b11-4473-b011-d21eb9e0b6ad None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:30.000530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628a2d-5b11-4473-b011-d21eb9e0b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:30.019317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-da628a2d-5b11-4473-b011-d21eb9e0b6ad None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:30.020879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-da628a2d-5b11-4473-b011-d21eb9e0b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:30.090465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 451/914] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:30.357559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56d5ff-bacf-403a-bb29-421c0139bdeb None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:30.464376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56d5ff-bacf-403a-bb29-421c0139bdeb None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:30.473966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:30.501193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:30.502162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:30.502627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:30.503073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:30.503855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:30.505471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:30.514820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:30.516003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:30.517062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:30.519455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 464/915] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:30.525535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628a2d-5b11-4473-b011-d21eb9e0b6ad None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:30.606816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:30.628569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628a2d-5b11-4473-b011-d21eb9e0b6ad None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:30.663224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:30.663880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:30.664160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:30.664430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:30.665100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:30.665475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:30.666896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:30.672006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 452/916] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:30.677571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:30.783125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88f25c-ba1f-44ff-a23e-1a15d7fc1bbd None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:30.816857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:30.817468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:30.817734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:30.817992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:30.818611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:30.818900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:30.820291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:30.825911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 465/917] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:30.831625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:30.932544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee86a4-5afc-46c0-b31a-9b53bbc41564 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:30.968656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f2c64-3066-4145-b740-0386f7ae5b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:30.969274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2c64-3066-4145-b740-0386f7ae5b84 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:30.969551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2c64-3066-4145-b740-0386f7ae5b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:30.969822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f2c64-3066-4145-b740-0386f7ae5b84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:30.970522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f2c64-3066-4145-b740-0386f7ae5b84 None admin] RBAC: Adding query filter params (interface=public, service_id=199c03d6a6be4c49a77af28e946167d4, region_id=RegionOne) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:30.970824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f2c64-3066-4145-b740-0386f7ae5b84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:30.972241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f2c64-3066-4145-b740-0386f7ae5b84 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:30.977970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 453/918] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:46:30 2022] GET /identity/v3/endpoints?service_id=199c03d6a6be4c49a77af28e946167d4&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:30.984073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:31.020069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:31.088952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf95d4-e826-417b-a9cb-752adc644e5d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:31.128242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8fc84-8fb6-4ea2-b5f6-b9381373ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:31.128851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8fc84-8fb6-4ea2-b5f6-b9381373ddf9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.129121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8fc84-8fb6-4ea2-b5f6-b9381373ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.129383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8fc84-8fb6-4ea2-b5f6-b9381373ddf9 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.129982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8fc84-8fb6-4ea2-b5f6-b9381373ddf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:31.131348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8fc84-8fb6-4ea2-b5f6-b9381373ddf9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:31.138210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 466/919] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:30 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:46:31.344885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57994f-e78d-4506-869d-726a9d02ab30 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.344885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57994f-e78d-4506-869d-726a9d02ab30 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.344885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57994f-e78d-4506-869d-726a9d02ab30 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.345539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 454/920] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:31.350959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae952-a34a-445f-b61d-9f2c10ab7f5e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.351274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae952-a34a-445f-b61d-9f2c10ab7f5e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.351511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dae952-a34a-445f-b61d-9f2c10ab7f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.375091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-99dae952-a34a-445f-b61d-9f2c10ab7f5e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:31.376733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-99dae952-a34a-445f-b61d-9f2c10ab7f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:31.458953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 467/921] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:31.467057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c715c1c-cd55-4fc4-96f4-21247b98d638 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.467433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c715c1c-cd55-4fc4-96f4-21247b98d638 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.467637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c715c1c-cd55-4fc4-96f4-21247b98d638 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.469351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 455/922] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:31.475084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258024-5f52-40ab-a6a6-3ecccbe3db8f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.475413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258024-5f52-40ab-a6a6-3ecccbe3db8f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.475630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258024-5f52-40ab-a6a6-3ecccbe3db8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.495871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-32258024-5f52-40ab-a6a6-3ecccbe3db8f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:31.497071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-32258024-5f52-40ab-a6a6-3ecccbe3db8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:31.528135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:31.566210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 468/923] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:31.595216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b9987-d03f-4c87-b171-09d39034d0b3 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.595724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b9987-d03f-4c87-b171-09d39034d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.595724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b9987-d03f-4c87-b171-09d39034d0b3 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.597287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 456/924] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:31.602588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0d7f-40ca-4d58-9fec-8c1b56308e82 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.602867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0d7f-40ca-4d58-9fec-8c1b56308e82 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.603133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0d7f-40ca-4d58-9fec-8c1b56308e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.621863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-329f0d7f-40ca-4d58-9fec-8c1b56308e82 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:31.623039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-329f0d7f-40ca-4d58-9fec-8c1b56308e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:31.695807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 469/925] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:31.738182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b9987-d03f-4c87-b171-09d39034d0b3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:31.748350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:31.848511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b9987-d03f-4c87-b171-09d39034d0b3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:31.871612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0d7f-40ca-4d58-9fec-8c1b56308e82 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:31.884570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:31.885204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:31.885646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:31.885917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:31.886493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:31.887881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:31.897273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:31.898307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:31.899779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 457/926] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:31.904263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:31.971105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:31.978679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:31.982333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0d7f-40ca-4d58-9fec-8c1b56308e82 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.014292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bd679-4a0d-4dbe-945d-e43a75e7c3e5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.017522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.018368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.018852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.019305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.031102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:32.036630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:32.037540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:32.038371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 470/927] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Sep 15 12:46:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:32.039096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.057942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.058578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.058853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.059122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.059913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:32.060102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.061525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.067118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 458/928] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:32.068457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.150860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7bfc8-86e0-4ae8-8997-7a271350cad9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.175272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13db5a0-37cd-4be7-ad69-949423482f00 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.186042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.186721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.187001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.187269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.187983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.189481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:32.199316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:32.200433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:32.201328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 471/929] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:32.202644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.214566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.215162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.215431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.215719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.216389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:32.216688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.218051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.219392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:32.220319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:32.227900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 459/930] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:32.228708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.319484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c005d5-0267-44e7-bd9c-6a514b4de45e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.336239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951708f0-a53c-4ec0-a321-024f1b7e5d9e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.360582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.361184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.361456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.361724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.362331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:32.362621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.364016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.369012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 472/931] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:32.369773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.379505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.380142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.380413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.380674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.381293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:32.381585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.382938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.388238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 460/932] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:32.388996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.455364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:32.471605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:32.494632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471336f-aefe-4b85-ba3c-d98fd2c00164 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.506017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a34301-30ea-4e0e-8380-3b970ca9ecf2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.530380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.531057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.531318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.531539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.541150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.541857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.542188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.542508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.543235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.543566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.544737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.545038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:32.560085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:32.561303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:32.562451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:32.562451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:32.562451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:32.576074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 473/933] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:32.576277 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 461/934] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:32.576361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.576435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.699622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da354655-45f4-4843-b850-a8d52b02e396 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.714752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203546d3-9d2c-41d9-93de-b54cfb016acc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.715579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:32.745344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.745961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.746234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.746497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.747419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:32.747419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.748892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.758962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:32.768679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 462/935] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:32.769823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.773449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.774395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.774395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.774695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.775242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:32.775534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.776988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.787727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 474/936] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:32.788192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.898523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a239-be9e-4544-9f60-1a782af849c1 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.913529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2548-4f97-44b6-bfe0-71249b33d6ff None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:32.940216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.940918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.941195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.941548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.951048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.951647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:32.952588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.952790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:32.953253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:32.953722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:32.954679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:32.956359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:32.965380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:32.966358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:32.967312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 463/937] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:32.972193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:32.987536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 475/938] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:33.018673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:33.100223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19918b95-787c-43cc-8d37-fcbe2bf2042b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:33.145912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:33.147112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:33.147621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:33.148118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:33.149124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:33.149879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:33.151884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:33.180101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 464/939] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Sep 15 12:46:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:33.183263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:33.241573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:33.297235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faac51-ddbf-450f-b85e-e53f723e15e0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:33.337760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3d67-620e-4f87-a7fc-d0c1b73c6626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:33.338786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3d67-620e-4f87-a7fc-d0c1b73c6626 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:33.339287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3d67-620e-4f87-a7fc-d0c1b73c6626 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:33.339796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3d67-620e-4f87-a7fc-d0c1b73c6626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:33.351736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3d67-620e-4f87-a7fc-d0c1b73c6626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:33.353704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3d67-620e-4f87-a7fc-d0c1b73c6626 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-739e3d67-620e-4f87-a7fc-d0c1b73c6626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:33.369489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:33.370480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:33.371371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:33.371371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:33.371371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:33.373562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 476/940] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:33.379426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:33.437736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7c227-6414-46cf-85bb-5c203e874997 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:33.438080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7c227-6414-46cf-85bb-5c203e874997 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:33.438281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7c227-6414-46cf-85bb-5c203e874997 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:33.439927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 477/941] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:33.447515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142ea7-f8aa-4f54-a484-e6641d607b7c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:33.447827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142ea7-f8aa-4f54-a484-e6641d607b7c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:33.448099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142ea7-f8aa-4f54-a484-e6641d607b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:33.469307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e4142ea7-f8aa-4f54-a484-e6641d607b7c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:33.470902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e4142ea7-f8aa-4f54-a484-e6641d607b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:33.486352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:33.502942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff04f5-74a3-40a2-b4c3-713e0cefb435 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:33.544450 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:33.545444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:33.545899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:33.546337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:33.547245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:33.547849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:33.549378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:33.559730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 478/942] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:33.570076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 465/943] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:33.575965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142ea7-f8aa-4f54-a484-e6641d607b7c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:33.620668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:33.681325 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142ea7-f8aa-4f54-a484-e6641d607b7c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:33.716188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:33.716818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:33.717084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:33.717347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:33.724277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:33.725713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:33.737262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:33.738349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:33.739435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 479/944] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:33.745806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:33.845529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:33.859852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c98a8-947e-42d7-9f5b-ed1b24634888 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:33.905220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:33.906117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:33.907649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:33.908793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:33.910225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:33.910674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:33.912285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:33.937069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 466/945] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:33.947392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:33.972272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:34.054320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:34.074136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6be77-ac75-4d05-9a54-6f2da72798f0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:34.128916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee6ec6-d51a-41af-b8da-e188e5fae2ec None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:34.166831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:34.168531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:34.169270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:34.169683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:34.170426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:34.170788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:34.171467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:34.171851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:34.172306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/b2684f91284d49fc98b4caaace8cbba4/roles/5339284d849f4b6f868fbb571a22b9e0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:34.173748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:34.177546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=b2684f91284d49fc98b4caaace8cbba4, role_id=5339284d849f4b6f868fbb571a22b9e0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:34.179055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:34.189678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:34.191607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:34.192774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:34.200001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 480/946] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:34.200958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:34.217887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 467/947] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:46:33 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/b2684f91284d49fc98b4caaace8cbba4/roles/5339284d849f4b6f868fbb571a22b9e0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:46:34.349777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491a8a0-5141-4348-8953-1e622b35a800 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:34.392256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:34.392799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:34.393076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:34.393341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:34.394032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:34.394393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:34.395884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:34.402052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 481/948] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:34.407956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:34.492040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:34.533294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52f8ea-928c-454b-9eec-264c96db7592 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:34.567466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cb0d7-5043-4f6d-90be-4fd5b8205cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:34.568158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb0d7-5043-4f6d-90be-4fd5b8205cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:34.568490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb0d7-5043-4f6d-90be-4fd5b8205cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:34.568760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb0d7-5043-4f6d-90be-4fd5b8205cb0 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:34.569390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cb0d7-5043-4f6d-90be-4fd5b8205cb0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:34.569690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cb0d7-5043-4f6d-90be-4fd5b8205cb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:34.571085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cb0d7-5043-4f6d-90be-4fd5b8205cb0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:34.576284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 468/949] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:34.582181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:34.604974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:34.687602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61375e7d-0063-472b-b7c7-5d04845ec9a9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:34.723503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24673297-9068-4e99-a98e-8313fbbe0bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:34.724391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673297-9068-4e99-a98e-8313fbbe0bd5 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:34.724811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673297-9068-4e99-a98e-8313fbbe0bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:34.725221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24673297-9068-4e99-a98e-8313fbbe0bd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:34.726056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24673297-9068-4e99-a98e-8313fbbe0bd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:34.727625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24673297-9068-4e99-a98e-8313fbbe0bd5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:34.751988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 482/950] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:34.883872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f5e2-cb4c-4d2c-bdb4-9ac12f205e7b None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:34.884413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f5e2-cb4c-4d2c-bdb4-9ac12f205e7b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:34.884526 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8f5e2-cb4c-4d2c-bdb4-9ac12f205e7b None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:34.886168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 469/951] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:34.892021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591cc28-56a6-4fba-b67c-abf2bd58cc07 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:34.892618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591cc28-56a6-4fba-b67c-abf2bd58cc07 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:34.893090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591cc28-56a6-4fba-b67c-abf2bd58cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:34.913671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4591cc28-56a6-4fba-b67c-abf2bd58cc07 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:34.915415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4591cc28-56a6-4fba-b67c-abf2bd58cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:34.995391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 483/952] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:35.259539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f5e2-cb4c-4d2c-bdb4-9ac12f205e7b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:35.368596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8f5e2-cb4c-4d2c-bdb4-9ac12f205e7b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:35.389636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3a14-ec6c-4c2f-ba6f-87e22d17c38b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:35.390189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3a14-ec6c-4c2f-ba6f-87e22d17c38b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:35.390189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3a14-ec6c-4c2f-ba6f-87e22d17c38b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:35.391498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 484/953] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:35.396643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91842-8d71-41bb-bb48-c652aff15e9c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:35.396922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91842-8d71-41bb-bb48-c652aff15e9c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:35.397188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d91842-8d71-41bb-bb48-c652aff15e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:35.404176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:35.405334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:35.411236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:35.413027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:35.413576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:35.413995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:35.415009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:35.416726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:35.419149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-06d91842-8d71-41bb-bb48-c652aff15e9c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:35.420579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING keystone.server.flask.common [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 12:46:35.421412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-06d91842-8d71-41bb-bb48-c652aff15e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:35.453094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.sql.core [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 12:46:35.453094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 12:46:35.453094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [parameters: {'id': 'ec6088c4377f443e876cb2a8d7879ec8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 12:46:35.453094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81588) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ec6088c4377f443e876cb2a8d7879ec8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ec6088c4377f443e876cb2a8d7879ec8. Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:46:35.463545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result.read() Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 15 12:46:35.464415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application yield resource Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise self.value Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application session.commit() Sep 15 12:46:35.465357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.session.flush() Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application compat.raise_( Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 12:46:35.466262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 12:46:35.467239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application result.read() Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:46:35.468104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [parameters: {'id': 'ec6088c4377f443e876cb2a8d7879ec8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:35.469871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:35.471759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ec6088c4377f443e876cb2a8d7879ec8. Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.473926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 470/954] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Sep 15 12:46:35 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:35.479743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:35.511687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 485/955] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:35.589347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eb7ae-2915-41c8-80f3-e8da79874244 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:35.624923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:35.625559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:35.625830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:35.626097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:35.633157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:35.634864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:35.646349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:35.647238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.648173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 471/956] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:35.656890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d91842-8d71-41bb-bb48-c652aff15e9c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:35.765214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d91842-8d71-41bb-bb48-c652aff15e9c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:35.794931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:35.800864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:35.801477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:35.801753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:35.802020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:35.802288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:35.802734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:35.803032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:35.804700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:35.831726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 486/957] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:35.857225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:35.917674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeb57e-00fe-4f4c-83fc-ed552d41d59e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:35.954421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:35.955068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:35.955339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:35.955609 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:35.956220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:35.957595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:35.967479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:35.968582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:35.969432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 472/958] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:35.977275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:36.091331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34c567-f52f-4423-b607-8ff78d2e3d9f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:36.127004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe648f70-b236-409e-b9c5-79926f18119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:36.127684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe648f70-b236-409e-b9c5-79926f18119e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:36.127988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe648f70-b236-409e-b9c5-79926f18119e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:36.128253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe648f70-b236-409e-b9c5-79926f18119e None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:36.128951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe648f70-b236-409e-b9c5-79926f18119e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:36.129250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe648f70-b236-409e-b9c5-79926f18119e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:36.130629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe648f70-b236-409e-b9c5-79926f18119e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:36.136298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 487/959] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:36.141896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:36.245012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91101fc7-9650-4401-81f0-3bc771adeaf4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:36.255879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:36.279982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df2531-b464-471d-a4b4-1e915defc922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:36.280594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2531-b464-471d-a4b4-1e915defc922 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:36.280862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2531-b464-471d-a4b4-1e915defc922 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:36.281122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2531-b464-471d-a4b4-1e915defc922 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:36.281742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df2531-b464-471d-a4b4-1e915defc922 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:36.282034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df2531-b464-471d-a4b4-1e915defc922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:36.283388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df2531-b464-471d-a4b4-1e915defc922 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:36.291140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 473/960] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:36.541389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37956721-6d09-48be-bb4a-e7d77c871a58 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:36.541930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37956721-6d09-48be-bb4a-e7d77c871a58 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:36.541930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37956721-6d09-48be-bb4a-e7d77c871a58 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:36.543541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 488/961] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:36.549134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c03652-6f31-41bf-a8fe-ff3dd5c3045b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:36.549419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c03652-6f31-41bf-a8fe-ff3dd5c3045b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:36.549693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c03652-6f31-41bf-a8fe-ff3dd5c3045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:36.568970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-34c03652-6f31-41bf-a8fe-ff3dd5c3045b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:36.570540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-34c03652-6f31-41bf-a8fe-ff3dd5c3045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:36.639686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 474/962] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:36.915423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37956721-6d09-48be-bb4a-e7d77c871a58 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:36.974736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:37.018253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105a93d-46b5-474c-a7e9-31247a5500bf None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.018821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105a93d-46b5-474c-a7e9-31247a5500bf None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.018821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105a93d-46b5-474c-a7e9-31247a5500bf None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.020472 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 475/963] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:37.025481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7606fc1-82aa-4f3b-9bcb-281b2ba09ed5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.025767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7606fc1-82aa-4f3b-9bcb-281b2ba09ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.026037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7606fc1-82aa-4f3b-9bcb-281b2ba09ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.029837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37956721-6d09-48be-bb4a-e7d77c871a58 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.044687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e7606fc1-82aa-4f3b-9bcb-281b2ba09ed5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:37.045881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e7606fc1-82aa-4f3b-9bcb-281b2ba09ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:37.066415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.067503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.067986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.068536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.079839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:37.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:37.092543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 489/964] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Sep 15 12:46:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:37.093509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.124379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 476/965] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:37.204373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d974bc-6ade-429e-87e6-55fb89d54d45 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.223436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:37.244758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.245427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.245706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.245972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.246644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:37.246940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.248377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.257685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 490/966] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:37.263608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7606fc1-82aa-4f3b-9bcb-281b2ba09ed5 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.298340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:37.365888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7606fc1-82aa-4f3b-9bcb-281b2ba09ed5 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.394631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.401653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.402535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.403019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.403491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.414489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.416478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:37.432170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:37.433164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:37.434055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:37.434055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:37.434055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:37.436690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 477/967] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:37.442975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.515351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cee23f-303b-403f-a47d-dab28b955255 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.532628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:37.549839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845619b1-cbcc-45f9-86ce-c4c60fc552ce None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.553588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.554230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.554503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.554766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.555589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.557044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:37.566803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:37.567874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:37.569356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 491/968] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:37.573779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.592879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.593863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.594352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.594838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.595848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:37.596440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.597926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.612150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 478/969] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:37.619209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.629005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:37.708403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad5b0-d75a-4fca-9163-5482778f5d9f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.728526 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55eea18-1b52-4274-9660-c910bd93cb23 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.744263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.745073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.745387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.745743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.746470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:37.746852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.748352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.753666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 492/970] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:37.759667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.766881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.767812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.768312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.768770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.776639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.778394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:37.791130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:37.792115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:46:37.793058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:37.800198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 479/971] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:37.801220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.811405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:37.882425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6cad7-16b7-4fd9-848e-9c39dd64f13a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.891907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:37.909804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ab268-a3ae-43b9-b078-eeb6d6b7d355 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:37.926662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.927482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.927839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.928167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.929099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:37.929463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.931574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.939748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 493/972] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:37.943841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:37.954028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:37.954652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:37.954929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:37.955197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:37.956239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:37.956349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:37.957773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:37.981453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 480/973] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:37.982400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.055150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:38.078549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62126a9f-83eb-4fd9-adee-5f8d3d1a88aa None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:38.097194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a2b8-d661-41e2-bfc3-cc2e9c82bf51 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:38.124882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:38.126052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.126900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.127628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.128539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] RBAC: Adding query filter params (interface=admin, service_id=199c03d6a6be4c49a77af28e946167d4, region_id=RegionOne) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:38.129236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:38.131575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:38.135536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:38.136183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.136529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.136866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.139532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 494/974] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/endpoints?service_id=199c03d6a6be4c49a77af28e946167d4&interface=admin®ion_id=RegionOne => generated 193 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:38.145802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.192706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:38.218755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:38.220605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:38.269414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bde46-f139-454a-beda-5eb4d2b838ce None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:38.294016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:38.306147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f64b2e-9993-42b8-907a-7f4d6d912f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:38.306681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64b2e-9993-42b8-907a-7f4d6d912f9d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.306957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64b2e-9993-42b8-907a-7f4d6d912f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.307229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f64b2e-9993-42b8-907a-7f4d6d912f9d None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.307862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f64b2e-9993-42b8-907a-7f4d6d912f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:38.309273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f64b2e-9993-42b8-907a-7f4d6d912f9d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:38.315213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 495/975] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:38 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:46:38.316703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9909-2d47-469b-9316-ef818f93f6ce None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.317156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9909-2d47-469b-9316-ef818f93f6ce None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.317593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9909-2d47-469b-9316-ef818f93f6ce None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.319303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 496/976] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:38.324961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8113e-0aff-4afe-86a7-90734f537e5d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.325558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8113e-0aff-4afe-86a7-90734f537e5d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.326016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8113e-0aff-4afe-86a7-90734f537e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.346117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-baf8113e-0aff-4afe-86a7-90734f537e5d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:38.347414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-baf8113e-0aff-4afe-86a7-90734f537e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:38.347965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 481/977] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:38.355308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.460199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 497/978] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:38.494490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234e02-03be-41e2-acb1-bf73ee14a4fe None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:38.532177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:38.532813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.533082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.533349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.544085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:38.545544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:38.561280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:38.562260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:38.563156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:38.563156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:38.563156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:38.563156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 482/979] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:38.566766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e068c9-b797-4fea-a2c1-af5cb86b2453 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.567223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e068c9-b797-4fea-a2c1-af5cb86b2453 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.567312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e068c9-b797-4fea-a2c1-af5cb86b2453 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.568810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.568922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 498/980] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:38.574444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169518-07ff-4a87-94f3-2ba57ac48ce4 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.574722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169518-07ff-4a87-94f3-2ba57ac48ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.574990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169518-07ff-4a87-94f3-2ba57ac48ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.598173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2e169518-07ff-4a87-94f3-2ba57ac48ce4 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:38.598851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:38.599626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2e169518-07ff-4a87-94f3-2ba57ac48ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:38.631621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:38.686276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 499/981] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:38.687120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727532-9499-4394-97ce-a395de8f2208 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:38.730500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:38.731479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.731997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.732476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.733638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:38.734130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:38.735667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:38.740370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169518-07ff-4a87-94f3-2ba57ac48ce4 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.748765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 483/982] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:38.754454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.836489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:38.855179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169518-07ff-4a87-94f3-2ba57ac48ce4 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:38.861548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d247-8414-4530-b955-4798eba968c1 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:38.894019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:38.894679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.894954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.895217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.895895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:38.897264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:38.897388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:38.898186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:38.898659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:38.899228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:38.900104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING keystone.server.flask.common [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 12:46:38.906865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:38.908625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:38.914944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.sql.core [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 12:46:38.914944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 12:46:38.914944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [parameters: {'user_id': 'c95cd40b61854f688ce25ab06a3f2a4e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 12:46:38.914944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81589) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:38.921823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:38.922732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:38.923613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:38.930788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 484/983] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:38.931880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application result.read() Sep 15 12:46:38.933890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:46:38.934832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application yield resource Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise self.value Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application session.commit() Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 12:46:38.935829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self.session.flush() Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application compat.raise_( Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 12:46:38.936921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:46:38.937790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application result.read() Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:46:38.938625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c95cd40b61854f688ce25ab06a3f2a4e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:38.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 15 12:46:38.941387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 500/984] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Sep 15 12:46:38 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:38.942940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:38.975301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:39.048695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cc22a-0c31-49b1-bf78-5cfdf0c1b248 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:39.067180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427174b-94a9-404c-95ef-1105c644315f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:39.084905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:39.085531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:39.085952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:39.086306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:39.087202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:39.087454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:39.088958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:39.092218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:39.108599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 485/985] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:39.108789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:39.108789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:39.108974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:39.109083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:39.109083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:39.117301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:39.119022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:39.130701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:39.131681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 501/986] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:39.137899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:39.221628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed663cd1-7cfe-41c7-b0a7-31bd169a4d14 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:39.222461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:39.242933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef422d8-5aa0-4b24-8875-293d37416f75 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:39.260339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:39.261061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:39.261410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:39.261750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:39.262483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:39.263943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:39.279185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3a492-7f13-4414-9800-6414cb08dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:39.279893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a492-7f13-4414-9800-6414cb08dc5b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:39.280168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a492-7f13-4414-9800-6414cb08dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:39.280431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a492-7f13-4414-9800-6414cb08dc5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:39.281169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a492-7f13-4414-9800-6414cb08dc5b None admin] RBAC: Adding query filter params (role.id=5339284d849f4b6f868fbb571a22b9e0, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=b2684f91284d49fc98b4caaace8cbba4) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:39.281470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a492-7f13-4414-9800-6414cb08dc5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:39.283879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 486/987] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:39 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:39.284063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a492-7f13-4414-9800-6414cb08dc5b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:39.284165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:39.304294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 502/988] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:39 2022] GET /identity/v3/role_assignments?user.id=b2684f91284d49fc98b4caaace8cbba4&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=5339284d849f4b6f868fbb571a22b9e0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:39.360404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:39.423541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c5e9-5747-43dc-a3c4-7bee256c2523 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:39.465763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31377981-f269-4b01-8f95-f0128eab93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:39.466404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31377981-f269-4b01-8f95-f0128eab93ae None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:39.466683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31377981-f269-4b01-8f95-f0128eab93ae None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:39.466954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31377981-f269-4b01-8f95-f0128eab93ae None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:39.467676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31377981-f269-4b01-8f95-f0128eab93ae None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:39.468008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31377981-f269-4b01-8f95-f0128eab93ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:39.469524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31377981-f269-4b01-8f95-f0128eab93ae None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:39.508681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 487/989] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Sep 15 12:46:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:40.581100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6e26-6e4b-4c5c-8c9d-8398d8295576 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:40.581638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6e26-6e4b-4c5c-8c9d-8398d8295576 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:40.581638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6e26-6e4b-4c5c-8c9d-8398d8295576 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:40.583138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 503/990] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:40.589138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882644-e9e7-4578-aa4e-ee5e825bd76b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:40.589584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882644-e9e7-4578-aa4e-ee5e825bd76b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:40.589658 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882644-e9e7-4578-aa4e-ee5e825bd76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:40.608779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-bc882644-e9e7-4578-aa4e-ee5e825bd76b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:40.609963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bc882644-e9e7-4578-aa4e-ee5e825bd76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:40.681846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 488/991] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:40.949866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6e26-6e4b-4c5c-8c9d-8398d8295576 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:41.077513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6e26-6e4b-4c5c-8c9d-8398d8295576 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:41.114424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:41.115073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.115342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.115590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.116192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:41.117684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:41.126870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:41.127853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:41.132742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 504/992] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Sep 15 12:46:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:41.134887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882644-e9e7-4578-aa4e-ee5e825bd76b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:41.179933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:41.241422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882644-e9e7-4578-aa4e-ee5e825bd76b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:41.274644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:41.275257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.275531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.275822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.276469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:41.276763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:41.278151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:41.283100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 489/993] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:41.288734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:41.306684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:41.409100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876d966-8fdf-4cba-ac60-17b528f77689 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:41.453306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d853c8-0062-429d-ad55-049a1925219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:41.453930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d853c8-0062-429d-ad55-049a1925219e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.454211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d853c8-0062-429d-ad55-049a1925219e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.454455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d853c8-0062-429d-ad55-049a1925219e None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.455094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d853c8-0062-429d-ad55-049a1925219e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:41.455382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d853c8-0062-429d-ad55-049a1925219e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:41.456871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d853c8-0062-429d-ad55-049a1925219e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:41.462349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 505/994] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Sep 15 12:46:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:41.467923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:41.481165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134772-a8f6-4e77-95c7-adbd93c1e82e None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.481457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134772-a8f6-4e77-95c7-adbd93c1e82e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.481718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134772-a8f6-4e77-95c7-adbd93c1e82e None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.483384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 506/995] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:41.488330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532dcb-39e5-456d-b57a-2333a9447ad0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.488618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532dcb-39e5-456d-b57a-2333a9447ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.488871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1532dcb-39e5-456d-b57a-2333a9447ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.507206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-d1532dcb-39e5-456d-b57a-2333a9447ad0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:41.508700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d1532dcb-39e5-456d-b57a-2333a9447ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:41.572204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dc7f7-760e-4d2c-9acc-c1c8cc298a5d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:41.574454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:41.574574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 507/996] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:41.575857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177a82-8a0d-4aba-8faf-2c1e792877e7 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.576138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177a82-8a0d-4aba-8faf-2c1e792877e7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.576393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177a82-8a0d-4aba-8faf-2c1e792877e7 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.577706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 508/997] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:41.583614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca2ab-c38a-4c05-9189-29e7d021f245 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.584233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca2ab-c38a-4c05-9189-29e7d021f245 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.584233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca2ab-c38a-4c05-9189-29e7d021f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.591400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:41.604388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6ecca2ab-c38a-4c05-9189-29e7d021f245 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:41.605583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6ecca2ab-c38a-4c05-9189-29e7d021f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:41.616210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:41.617177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.617409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.617836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.618519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:41.619910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:41.651761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 490/998] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:41.685837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 509/999] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:41.847047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:41.950569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecca2ab-c38a-4c05-9189-29e7d021f245 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:41.952605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b567d-a4e0-4cb2-8ad7-02b9d162fb39 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:41.992053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:41.993413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:41.993884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:41.994424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:41.995186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:41.997020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:42.008940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:42.010249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:42.011305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:42.018444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 491/1000] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:42.020124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:42.050034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:42.061294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecca2ab-c38a-4c05-9189-29e7d021f245 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:42.091142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:42.100410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:42.101002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:42.101351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:42.101822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] PATH_INFO: `/v3/services/image` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:42.102257 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:42.103782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:42.113781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:42.114840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:42.115740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 510/1001] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Sep 15 12:46:41 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:42.120900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:42.128592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44a060-334d-451b-9c0b-96a737091424 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:42.165291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:42.165905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:42.166177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:42.166438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:42.167142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:42.167439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:42.168932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.175748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 492/1002] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:42.179541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:42.227506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acae90-c176-4a09-ba62-b7b457a9578e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:42.262879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:42.263940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:42.264220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:42.264485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:42.265099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] RBAC: Adding query filter params (name=image) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:42.265739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:42.267470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.272360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 511/1003] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:42.278147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:42.280407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:42.290845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05770c25-4b6a-43dc-bdc4-163e679bf977 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:42.327675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:42.328307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:42.328579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:42.328841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:42.329481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:42.329848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:42.331214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.333152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:42.343742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 493/1004] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:42.344853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:42.387848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f794a-d84b-4d4d-aeff-537ffa0cd960 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:42.432541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:42.433320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:42.433591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:42.433851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:42.434493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] RBAC: Adding query filter params (type=image) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:42.434786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:42.436197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.441229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 512/1005] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:42.463881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4ad00-becf-4aca-9acb-dce830334f40 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:42.501517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eac416-2edb-47c2-a4fa-c02ec3ec7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:42.502151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac416-2edb-47c2-a4fa-c02ec3ec7499 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:42.502423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac416-2edb-47c2-a4fa-c02ec3ec7499 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:42.502686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eac416-2edb-47c2-a4fa-c02ec3ec7499 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:42.503511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eac416-2edb-47c2-a4fa-c02ec3ec7499 None admin] RBAC: Adding query filter params (interface=public, service_id=7547fe90670b461ea883ef521ddf8ecd, region_id=RegionOne) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:42.503847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eac416-2edb-47c2-a4fa-c02ec3ec7499 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:42.505270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eac416-2edb-47c2-a4fa-c02ec3ec7499 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.511597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 494/1006] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:46:42 2022] GET /identity/v3/endpoints?service_id=7547fe90670b461ea883ef521ddf8ecd&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:42.517323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:42.630407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0b9e4-b821-41d6-9099-bc8fa681967d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:42.652746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:42.668246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5d542-3ccb-4736-9073-9d6faac3c224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:42.669011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5d542-3ccb-4736-9073-9d6faac3c224 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:42.669393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5d542-3ccb-4736-9073-9d6faac3c224 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:42.669757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5d542-3ccb-4736-9073-9d6faac3c224 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:42.670456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5d542-3ccb-4736-9073-9d6faac3c224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:42.671981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5d542-3ccb-4736-9073-9d6faac3c224 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:42.678654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 513/1007] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:42 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:46:43.812027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0249a7-09a4-4225-824e-0f6a73f185f8 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:43.812531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0249a7-09a4-4225-824e-0f6a73f185f8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:43.812531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0249a7-09a4-4225-824e-0f6a73f185f8 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:43.814011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 495/1008] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:43.819507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f612c2-b49e-41aa-8b2f-16aea17f81f8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:43.819938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f612c2-b49e-41aa-8b2f-16aea17f81f8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:43.820183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f612c2-b49e-41aa-8b2f-16aea17f81f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:43.839254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-66f612c2-b49e-41aa-8b2f-16aea17f81f8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:43.840498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-66f612c2-b49e-41aa-8b2f-16aea17f81f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:43.910025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 514/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:44.172440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0249a7-09a4-4225-824e-0f6a73f185f8 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:44.196965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:44.282020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0249a7-09a4-4225-824e-0f6a73f185f8 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:44.317208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f5e8-aa2a-4675-8625-10bd63cfe086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:44.317847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f5e8-aa2a-4675-8625-10bd63cfe086 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:44.318119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f5e8-aa2a-4675-8625-10bd63cfe086 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:44.318385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f5e8-aa2a-4675-8625-10bd63cfe086 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:44.319484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f5e8-aa2a-4675-8625-10bd63cfe086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:44.321297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f5e8-aa2a-4675-8625-10bd63cfe086 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:44.323071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 496/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:44.328850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f612c2-b49e-41aa-8b2f-16aea17f81f8 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:44.443476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f612c2-b49e-41aa-8b2f-16aea17f81f8 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:44.458779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:44.481352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1c01d-1013-4782-8cd1-fb6a541ff8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:44.481990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1c01d-1013-4782-8cd1-fb6a541ff8ac None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:44.482245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1c01d-1013-4782-8cd1-fb6a541ff8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:44.482521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1c01d-1013-4782-8cd1-fb6a541ff8ac None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:44.483502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1c01d-1013-4782-8cd1-fb6a541ff8ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:44.484961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1c01d-1013-4782-8cd1-fb6a541ff8ac None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:44.514864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 515/1011] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:44 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:44.699820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cced-8ad7-4ca6-8795-fb606f375e73 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:44.700015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cced-8ad7-4ca6-8795-fb606f375e73 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:44.700290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cced-8ad7-4ca6-8795-fb606f375e73 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:44.701934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 497/1012] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:44.707071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ca51-4cfb-4b96-9621-76506652c45e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:44.707354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ca51-4cfb-4b96-9621-76506652c45e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:44.707625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ca51-4cfb-4b96-9621-76506652c45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:44.728570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0761ca51-4cfb-4b96-9621-76506652c45e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:44.729797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0761ca51-4cfb-4b96-9621-76506652c45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:44.803105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 516/1013] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:44.841959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe1eb-83c8-43d5-8b78-23057885d713 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:44.842555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe1eb-83c8-43d5-8b78-23057885d713 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:44.842555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe1eb-83c8-43d5-8b78-23057885d713 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:44.844018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 498/1014] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:44.849123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7d82-b303-4ee9-98e3-630bbcd7ccaa None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:44.849532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7d82-b303-4ee9-98e3-630bbcd7ccaa None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:44.849630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7d82-b303-4ee9-98e3-630bbcd7ccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:44.869177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9d9c7d82-b303-4ee9-98e3-630bbcd7ccaa None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:44.870349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9d9c7d82-b303-4ee9-98e3-630bbcd7ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:44.940771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 517/1015] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:45.078746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe1eb-83c8-43d5-8b78-23057885d713 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:45.173468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:45.186928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe1eb-83c8-43d5-8b78-23057885d713 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:45.209073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7d82-b303-4ee9-98e3-630bbcd7ccaa None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:45.224080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:45.225126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:45.225647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:45.225936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:45.226963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:45.228705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:45.238183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:45.255746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 499/1016] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:46:45 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:46:45.332937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7d82-b303-4ee9-98e3-630bbcd7ccaa None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:45.378868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:45.379521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:45.379822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:45.380085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:45.380658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:45.382041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:45.392190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:45.393281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:45.396849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 518/1017] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:45.399854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:45.515858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c71d6-57a7-4074-ab17-90d56e1ccfe3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:45.549721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:45.550325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:45.550596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:45.550852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:45.551467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:45.551777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:45.553136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:45.558292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 500/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:45.564232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:45.652894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:45.671056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a8fc-fa4e-4804-ad81-50ccc3b97fdb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:45.705920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c841f-7c0d-426a-aa07-564359f70bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:45.706525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c841f-7c0d-426a-aa07-564359f70bcb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:45.706762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c841f-7c0d-426a-aa07-564359f70bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:45.707056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c841f-7c0d-426a-aa07-564359f70bcb None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:45.707673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c841f-7c0d-426a-aa07-564359f70bcb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:45.707996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c841f-7c0d-426a-aa07-564359f70bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:45.709358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c841f-7c0d-426a-aa07-564359f70bcb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:45.715134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 519/1019] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Sep 15 12:46:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:45.720784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:45.737467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:45.826458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8bcc3-5f60-4134-816a-9ce791fca57f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:45.860525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326076-9090-4944-9249-89adf0ddafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:45.861154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326076-9090-4944-9249-89adf0ddafdd None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:45.861416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326076-9090-4944-9249-89adf0ddafdd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:45.861672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326076-9090-4944-9249-89adf0ddafdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:45.862346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71326076-9090-4944-9249-89adf0ddafdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:45.863798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71326076-9090-4944-9249-89adf0ddafdd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:45.885584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 501/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:46:46.723973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26226ea3-dd3f-4a8a-9e32-74a577b74135 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:46.724509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26226ea3-dd3f-4a8a-9e32-74a577b74135 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:46.724509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26226ea3-dd3f-4a8a-9e32-74a577b74135 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:46.725951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 520/1021] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:46.731066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91c84e-b9c8-471b-b43e-16c145b8fff3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:46.731351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91c84e-b9c8-471b-b43e-16c145b8fff3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:46.731620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91c84e-b9c8-471b-b43e-16c145b8fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:46.751484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3b91c84e-b9c8-471b-b43e-16c145b8fff3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:46.752737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3b91c84e-b9c8-471b-b43e-16c145b8fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:46.815749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:46.835915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 502/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:47.099918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26226ea3-dd3f-4a8a-9e32-74a577b74135 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:47.207624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26226ea3-dd3f-4a8a-9e32-74a577b74135 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:47.242224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a079c66-dd71-49e5-a682-bd492e013fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:47.242853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079c66-dd71-49e5-a682-bd492e013fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:47.243123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079c66-dd71-49e5-a682-bd492e013fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:47.243387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079c66-dd71-49e5-a682-bd492e013fb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:47.244671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a079c66-dd71-49e5-a682-bd492e013fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:47.246114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a079c66-dd71-49e5-a682-bd492e013fb4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:47.251743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 521/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:47.253415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91c84e-b9c8-471b-b43e-16c145b8fff3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:47.354503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91c84e-b9c8-471b-b43e-16c145b8fff3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:47.392253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2989-b789-4a35-b497-5420d8462407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:47.392866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2989-b789-4a35-b497-5420d8462407 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:47.393138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2989-b789-4a35-b497-5420d8462407 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:47.393402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2989-b789-4a35-b497-5420d8462407 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:47.394065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2989-b789-4a35-b497-5420d8462407 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:47.395512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2989-b789-4a35-b497-5420d8462407 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:47.421142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 503/1024] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:46:47 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:47.498700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d245a8-c808-426e-b6a7-5a3c14970e7d None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:47.499032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d245a8-c808-426e-b6a7-5a3c14970e7d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:47.499251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d245a8-c808-426e-b6a7-5a3c14970e7d None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:47.500707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 522/1025] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:47.506811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00765fee-75b3-40cd-b70a-4d477af5bf96 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:47.507117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00765fee-75b3-40cd-b70a-4d477af5bf96 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:47.507363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00765fee-75b3-40cd-b70a-4d477af5bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:47.528682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-00765fee-75b3-40cd-b70a-4d477af5bf96 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:47.529891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-00765fee-75b3-40cd-b70a-4d477af5bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:47.583734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:47.610013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 504/1026] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:47.881785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d245a8-c808-426e-b6a7-5a3c14970e7d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:47.902800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:47.990702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d245a8-c808-426e-b6a7-5a3c14970e7d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:48.028232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b54002-bb7f-4199-a193-bea9993f9267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:48.028916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54002-bb7f-4199-a193-bea9993f9267 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.029186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54002-bb7f-4199-a193-bea9993f9267 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.029446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54002-bb7f-4199-a193-bea9993f9267 None admin] PATH_INFO: `/v3/services/image` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.030028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b54002-bb7f-4199-a193-bea9993f9267 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:48.031456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b54002-bb7f-4199-a193-bea9993f9267 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-e2b54002-bb7f-4199-a193-bea9993f9267 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:48.041868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:48.043059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:48.044085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 523/1027] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Sep 15 12:46:47 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:48.051191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00765fee-75b3-40cd-b70a-4d477af5bf96 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:48.135449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf3a9-2f3e-4a0f-b724-d6433854119e None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.135638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf3a9-2f3e-4a0f-b724-d6433854119e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.135930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf3a9-2f3e-4a0f-b724-d6433854119e None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.137428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 524/1028] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:48.143069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2129955-726b-4aa5-829f-b6a67944f4e5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.143333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2129955-726b-4aa5-829f-b6a67944f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.143601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2129955-726b-4aa5-829f-b6a67944f4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.157553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00765fee-75b3-40cd-b70a-4d477af5bf96 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:48.161656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-d2129955-726b-4aa5-829f-b6a67944f4e5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:48.162828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d2129955-726b-4aa5-829f-b6a67944f4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:48.195948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:48.197078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.197523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.197941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.198698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] RBAC: Adding query filter params (name=image) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:48.199130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:48.200657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:48.205888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 505/1029] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:48.211928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:48.235282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 525/1030] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:48.264856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:48.321473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36503d3-1ded-4b4f-ae16-6b860ae5eaef None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:48.356358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:48.356966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.357205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.357501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.358444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] RBAC: Adding query filter params (type=image) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:48.358743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:48.360158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:48.366041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 506/1031] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:48.372144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2129955-726b-4aa5-829f-b6a67944f4e5 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:48.387894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:48.485220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2129955-726b-4aa5-829f-b6a67944f4e5 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:48.511584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:48.522604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:48.524184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.524621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.524890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.525601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] RBAC: Adding query filter params (interface=public, service_id=fd7c5608e3954679afe1d1c98f74c0f6, region_id=RegionOne) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:48.525896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:48.527273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:48.537011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 526/1032] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:46:48 2022] GET /identity/v3/endpoints?service_id=fd7c5608e3954679afe1d1c98f74c0f6&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:48.538026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:48.620479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:48.622632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dab69b-a1b1-475a-b9d1-1cc4fbaea41a None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:48.631747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:48.647312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1a65-51e2-4600-aac4-28b2c025c869 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:48.659579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:48.660236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.660507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.660920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.672106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:48.677651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:48.678777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:48.679888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:48.680902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 507/1033] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Sep 15 12:46:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:48.684200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:48.684919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.685191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.685448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.686793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:48.687281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:48.689100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:48.696935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 527/1034] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:46:48 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:46:48.818208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ce51-abf6-4628-90bf-8b6f7796c23e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:48.856691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:48.857309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:48.857566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:48.858166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:48.858831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:48.859123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:48.860538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:48.875499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 508/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Sep 15 12:46:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:48.876713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:48.983299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb8a96-fefd-41cf-a75d-c2c112cab4bd None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:49.018497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:49.019131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:49.019405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:49.019641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:49.028621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:49.030815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:49.032401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:49.047814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:49.048817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:49.049721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:49.049721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:49.049721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:49.049721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 528/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:49.056055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:49.092326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:49.166985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27bc7b-3cca-4b0e-b452-b70e04323c2d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:49.203506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:49.205657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:49.205657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:49.205657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:49.205657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:49.205657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:49.206897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:49.219141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 509/1037] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:49.224775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:49.324817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c19c-ac0d-4411-bda9-d9c56a910525 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:49.361443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:49.362079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:49.362345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:49.362609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:49.370678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:49.372159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:49.383904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:49.384874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:49.385843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:49.387865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 529/1038] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:46:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:49.390810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:49.489683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:49.500320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a780-8f94-4a96-a44d-9616dd86feda None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:49.537012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295cf0c-a319-441e-98c3-375bbff4b72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:49.537649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295cf0c-a319-441e-98c3-375bbff4b72e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:49.537926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295cf0c-a319-441e-98c3-375bbff4b72e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:49.538197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295cf0c-a319-441e-98c3-375bbff4b72e None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:49.538989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295cf0c-a319-441e-98c3-375bbff4b72e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:49.539291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295cf0c-a319-441e-98c3-375bbff4b72e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:49.540803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295cf0c-a319-441e-98c3-375bbff4b72e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:49.561500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 510/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:46:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:49.567236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:49.624414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:49.653088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0df34-fb80-44cb-b37c-93abfc0c8d2f None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:49.653363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0df34-fb80-44cb-b37c-93abfc0c8d2f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:49.653628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0df34-fb80-44cb-b37c-93abfc0c8d2f None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:49.654975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 511/1040] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:49.660283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e519-9939-42fe-b561-8e025d85ddd2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:49.660558 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e519-9939-42fe-b561-8e025d85ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:49.660822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1e519-9939-42fe-b561-8e025d85ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:49.677776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2106b1e-3ee8-4e5e-b9cb-a8966b5234b1 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:49.684391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-beb1e519-9939-42fe-b561-8e025d85ddd2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:49.686048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-beb1e519-9939-42fe-b561-8e025d85ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:49.712747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:49.713362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:49.713639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:49.713902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:49.775733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 512/1041] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:49.782721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:49.784245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:49.837157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:49.888388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 530/1042] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:49.894052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1e519-9939-42fe-b561-8e025d85ddd2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:49.973293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:49.997072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1e519-9939-42fe-b561-8e025d85ddd2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.030116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.030869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.031492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.031792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.032057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.042367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.043824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:50.059244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:50.060414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:50.061552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:50.061552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:50.061552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:50.063009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 513/1043] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:50.068619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.140682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b1a4-26f8-456e-b7fe-690bd2d8d06e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.174932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657b04d-f891-40fd-b9f9-ac8f987a490f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.176971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.178548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.178824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.179230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.189680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:50.194423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:50.195381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:50.196261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 531/1044] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:50.201617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.207282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:50.215652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.216329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.216767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.216894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:50.217046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.218055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:50.218366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.219958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.237193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 514/1045] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:50.238207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.310304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f81264-2048-4d91-b0a1-4eacb189f650 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.347077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.347627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.347931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.348206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.348872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:50.349170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.350542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.351750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32fdaa-fcb3-44c7-8d46-e60932e13c8f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.363737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 532/1046] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:50.365525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.394783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.395368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.395669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.395960 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.404560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.405994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:50.417888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:50.418800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:50.420037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 515/1047] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:50.425028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.463758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:50.490248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:50.492039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005820a-936c-4fc4-8f90-f2535e1f49c2 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.529610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.530438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.530551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.530774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] PATH_INFO: `/v3/users/b01ccd8183c44c2498b5b105415d99db` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.542589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f38fdb-0c16-43a7-88a7-ecf000840062 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.546145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] RBAC: Authorizing `identity:get_user(user_id=b01ccd8183c44c2498b5b105415d99db)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.547589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.549522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 533/1048] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/users/b01ccd8183c44c2498b5b105415d99db => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:50.556039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.578102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.579130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.579411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.579860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.580553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:50.581016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.582768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.595425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 516/1049] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:50.602217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.672475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99359c-50f0-435e-93fb-7929efb0bf27 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.701857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:50.707453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.708109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.708382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.708483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3fb0-9e6d-43f0-9295-17bb09acc143 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:50.708665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.719747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:50.752498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22a235-ae21-4fbd-9fd9-618bb17cd8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:50.753167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a235-ae21-4fbd-9fd9-618bb17cd8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.753492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a235-ae21-4fbd-9fd9-618bb17cd8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.753714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a235-ae21-4fbd-9fd9-618bb17cd8a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.754690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22a235-ae21-4fbd-9fd9-618bb17cd8a3 None admin] RBAC: Adding query filter params (role.id=5339284d849f4b6f868fbb571a22b9e0, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=ac2cabfcf8224f70a3129dc308e67b4f) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:50.754804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22a235-ae21-4fbd-9fd9-618bb17cd8a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.756246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22a235-ae21-4fbd-9fd9-618bb17cd8a3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.771742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 517/1050] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/role_assignments?user.id=ac2cabfcf8224f70a3129dc308e67b4f&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=5339284d849f4b6f868fbb571a22b9e0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:50.795623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:50.797270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:50.883879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f83fb1-a5ba-4c6a-8b92-c5875afe982b None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.884161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f83fb1-a5ba-4c6a-8b92-c5875afe982b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.884430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f83fb1-a5ba-4c6a-8b92-c5875afe982b None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.885814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 518/1051] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:50.891934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dca50-f0a4-403f-8520-ae64a82b8f9d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:50.892204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dca50-f0a4-403f-8520-ae64a82b8f9d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:50.892622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dca50-f0a4-403f-8520-ae64a82b8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:50.912010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-842dca50-f0a4-403f-8520-ae64a82b8f9d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:50.913405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-842dca50-f0a4-403f-8520-ae64a82b8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:50.915476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 534/1052] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:46:50.921494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:50.954794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:50.991740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 519/1053] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:46:51.031516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b055d-1ad5-4287-bf95-79b9f067ff9d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:51.067362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:51.068043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:51.068321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:51.068589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:51.069817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] RBAC: Authorizing `identity:get_project(project_id=ba8664899bdc4e138d17b1fa26d9041c)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:51.071149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:51.077841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 535/1054] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:46:50 2022] GET /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:51.078989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dca50-f0a4-403f-8520-ae64a82b8f9d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:51.186117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dca50-f0a4-403f-8520-ae64a82b8f9d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:51.188509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:51.221478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:51.222007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:51.222285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:51.222554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:51.223275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=ba8664899bdc4e138d17b1fa26d9041c, user.id=b01ccd8183c44c2498b5b105415d99db) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:51.223576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:51.225048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:51.235940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 520/1055] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:51 2022] GET /identity/v3/role_assignments?user.id=b01ccd8183c44c2498b5b105415d99db&scope.project.id=ba8664899bdc4e138d17b1fa26d9041c&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:51.258023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:51.367129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:51.371635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ec120-c4f3-44c2-9b5d-5b052d4fe1fc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:51.411185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:51.411853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:51.412114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:51.412380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] PATH_INFO: `/v3/services/image` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:51.412958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:51.414516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:51.425946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:51.426987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:46:51.427890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:51.431799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 536/1056] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Sep 15 12:46:51 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:51.433589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:51.537740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08dbac-9a52-42e9-ab5d-6ee58fbf1489 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:51.571588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:51.572235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:51.572503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:51.572760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:51.573376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] RBAC: Adding query filter params (name=image) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:51.573671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:51.575029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:51.580341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 521/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:51.586020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:51.691917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851524e-2e69-4c0c-890a-2078622ed1ca None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:51.725660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db666709-8385-4eba-8049-eebccb8366b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:51.726392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db666709-8385-4eba-8049-eebccb8366b4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:51.726666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db666709-8385-4eba-8049-eebccb8366b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:51.726929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db666709-8385-4eba-8049-eebccb8366b4 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:51.727543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db666709-8385-4eba-8049-eebccb8366b4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:51.727864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db666709-8385-4eba-8049-eebccb8366b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:51.729227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db666709-8385-4eba-8049-eebccb8366b4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:51.734653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 537/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:51.740243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:51.773096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:51.845311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d79a-21de-443d-8311-ded7bd2cf57f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:51.880300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecfa4d-bbee-46cf-9f45-3747cd4af9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:51.880914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecfa4d-bbee-46cf-9f45-3747cd4af9d0 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:51.881187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecfa4d-bbee-46cf-9f45-3747cd4af9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:51.881457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecfa4d-bbee-46cf-9f45-3747cd4af9d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:51.882162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecfa4d-bbee-46cf-9f45-3747cd4af9d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:51.883616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecfa4d-bbee-46cf-9f45-3747cd4af9d0 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:51.911502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 522/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:46:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:46:52.974235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139c080-9a08-492b-af53-4547ea0047dc None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:52.974820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139c080-9a08-492b-af53-4547ea0047dc None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:52.974820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139c080-9a08-492b-af53-4547ea0047dc None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:52.976809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 538/1060] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:52.982359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62846-74d4-4797-aee0-fa5660b7ede9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:52.983140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62846-74d4-4797-aee0-fa5660b7ede9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:52.983215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62846-74d4-4797-aee0-fa5660b7ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:53.002387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-7da62846-74d4-4797-aee0-fa5660b7ede9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:53.003562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7da62846-74d4-4797-aee0-fa5660b7ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:53.081559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 523/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:53.350805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139c080-9a08-492b-af53-4547ea0047dc None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:53.382183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:53.409201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47439-10b4-4862-bc6b-ac0d2a7d72d8 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:53.409525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47439-10b4-4862-bc6b-ac0d2a7d72d8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:53.409730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c47439-10b4-4862-bc6b-ac0d2a7d72d8 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:53.411303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 524/1062] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:46:53.416252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee211b5-6865-47f0-bcc5-cf261f3e71b3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:53.416498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee211b5-6865-47f0-bcc5-cf261f3e71b3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:53.416788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee211b5-6865-47f0-bcc5-cf261f3e71b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:53.438565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-7ee211b5-6865-47f0-bcc5-cf261f3e71b3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:53.440245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7ee211b5-6865-47f0-bcc5-cf261f3e71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:53.450497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:53.466617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139c080-9a08-492b-af53-4547ea0047dc None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:53.502213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:53.502848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:53.503118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:53.503375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:53.515582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:53.518612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 525/1063] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:53.521063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:53.522277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:53.523560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 539/1064] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Sep 15 12:46:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:53.528089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:53.620867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:53.634034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393c4ac-9c41-46ac-bf86-dd0eeb0fc507 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:53.668720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:53.669327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:53.669601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:53.669859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:53.670508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:53.670801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:53.672204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:53.681153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 540/1065] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Sep 15 12:46:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:53.686706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee211b5-6865-47f0-bcc5-cf261f3e71b3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:53.785682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:53.793388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee211b5-6865-47f0-bcc5-cf261f3e71b3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:53.831970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:53.832612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:53.832892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:53.833153 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:53.843981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:53.845430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:53.847868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:53.861371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:53.862340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:53.863231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:53.863231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:53.863231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:53.869921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 526/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:53.871650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:53.905728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ede11-2e9c-4790-a5bc-3c0c9d30f2c9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:53.941046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:53.941677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:53.941947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:53.942207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:53.952532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:53.957965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:53.959097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:53.960015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 541/1067] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:53.965786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:53.979982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:53.986772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8faa1b-581f-490f-875f-a029c3d946d8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.024959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.025997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.026270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.026610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.027157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:54.027452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.028858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.045535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 527/1068] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:54.046928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.073162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0cb46-0dec-4338-a8a5-3785e30300f3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.107840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.108045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ebc68-6871-4dc4-af81-039f2338775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.108451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebc68-6871-4dc4-af81-039f2338775e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.108739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebc68-6871-4dc4-af81-039f2338775e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.108990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebc68-6871-4dc4-af81-039f2338775e None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.109638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ebc68-6871-4dc4-af81-039f2338775e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:54.109923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ebc68-6871-4dc4-af81-039f2338775e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.111289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ebc68-6871-4dc4-af81-039f2338775e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.120119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 542/1069] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:54.121348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1938d20-909e-46e9-893a-b62b54cc8b07 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.121626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1938d20-909e-46e9-893a-b62b54cc8b07 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.121935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1938d20-909e-46e9-893a-b62b54cc8b07 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.123052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 543/1070] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:54.125631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1938d20-909e-46e9-893a-b62b54cc8b07 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.159460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db560a-a868-4ba5-9b59-071105b93030 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.192584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935a7ec-49bb-470c-a95f-6d6340cf18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.193208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935a7ec-49bb-470c-a95f-6d6340cf18aa None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.193479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935a7ec-49bb-470c-a95f-6d6340cf18aa None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.193654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.193753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935a7ec-49bb-470c-a95f-6d6340cf18aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.200780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935a7ec-49bb-470c-a95f-6d6340cf18aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.202202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935a7ec-49bb-470c-a95f-6d6340cf18aa None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-5935a7ec-49bb-470c-a95f-6d6340cf18aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:54.213527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:54.214491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:54.215435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 528/1071] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:54.216062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d7d13-ae80-45ca-9467-a3d7769d772f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.216840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d7d13-ae80-45ca-9467-a3d7769d772f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.216840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d7d13-ae80-45ca-9467-a3d7769d772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.227342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1938d20-909e-46e9-893a-b62b54cc8b07 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.234942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e53d7d13-ae80-45ca-9467-a3d7769d772f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:54.236164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e53d7d13-ae80-45ca-9467-a3d7769d772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:54.261487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.262114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.262387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.262651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] PATH_INFO: `/v3/users/b01ccd8183c44c2498b5b105415d99db` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.263806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] RBAC: Authorizing `identity:get_user(user_id=b01ccd8183c44c2498b5b105415d99db)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.265236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.266907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 544/1072] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/users/b01ccd8183c44c2498b5b105415d99db => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:54.267657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.302353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 529/1073] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:54.303204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d7d13-ae80-45ca-9467-a3d7769d772f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.355179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.372876 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c3587-560f-48c1-98d7-f2a6f0ea9035 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.405507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.406175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.406452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.406716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.407440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:54.407786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.409179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.413930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d7d13-ae80-45ca-9467-a3d7769d772f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.418400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.427500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 545/1074] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:54.433341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.464702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.465700 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.466145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.466729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.468640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ba8664899bdc4e138d17b1fa26d9041c)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.470275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.475846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 530/1075] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:54.477838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.551177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d234-5529-40e3-b831-b5ca94834c2d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.585355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.586386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.586660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.586924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.587475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c794a9-6b9e-4f99-b5c7-b472ce68c0d2 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.598250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.599750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.601556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:54.614814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:54.615944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:54.617031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:54.617031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:54.617031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:54.617031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 546/1076] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:54.617405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.626470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.627074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.627367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.627629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c/users/b01ccd8183c44c2498b5b105415d99db/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.629576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba8664899bdc4e138d17b1fa26d9041c, user_id=b01ccd8183c44c2498b5b105415d99db, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.630984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.645456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 531/1077] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:46:54 2022] PUT /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c/users/b01ccd8183c44c2498b5b105415d99db/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:46:54.646235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.671418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.733285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35bfb3-18de-4e51-9bf6-6e32ce61bf23 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.768796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768471f-2e37-423c-b9cf-f4c412befcb6 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.771318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.772044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.772324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.772650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.806868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.807496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.807794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.808061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.808702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:54.808992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.810436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.826678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 532/1078] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:54.831764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.856367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.858166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:54.871072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.909452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:54.940727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b3db-9862-4d7d-a884-8134b2f0f903 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:54.962893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 547/1079] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:54.968762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:54.980714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:54.981563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:54.981995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:54.982768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:54.989895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:54.991415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:55.002900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:55.003852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:55.004749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 533/1080] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:55.010296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:55.074488 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2d633-b334-4b64-b4a2-387dbc0f1ace None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:55.110643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:55.111017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:55.111754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:55.112134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:55.112657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:55.118848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77d818-955d-406a-b91c-8d7630c3e155 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:55.124578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:55.126031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:55.142145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:55.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:55.144391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:55.144391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:55.144391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:55.144391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 548/1081] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:55.149542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:55.152438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:55.160499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:55.161125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:55.161648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:55.161970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:55.162725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:55.163160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:55.164794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:55.183002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 534/1082] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:55.183978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:55.263777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a2db-030d-411f-81c2-8d6af6e6e1eb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:55.288466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ba100-d33e-4bfa-b9ac-18ab3c7174df None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:55.298663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee2409-51e6-4e14-9e04-6483e4b3a65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:55.300029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2409-51e6-4e14-9e04-6483e4b3a65e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:55.300564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2409-51e6-4e14-9e04-6483e4b3a65e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:55.301397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee2409-51e6-4e14-9e04-6483e4b3a65e None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:55.302099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2409-51e6-4e14-9e04-6483e4b3a65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:55.302456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2409-51e6-4e14-9e04-6483e4b3a65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:55.304034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee2409-51e6-4e14-9e04-6483e4b3a65e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:55.324931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50035c14-1e17-4d2c-a405-af626a68288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:55.325482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 549/1083] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:55.325602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50035c14-1e17-4d2c-a405-af626a68288d None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:55.325876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50035c14-1e17-4d2c-a405-af626a68288d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:55.326143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50035c14-1e17-4d2c-a405-af626a68288d None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/ac2cabfcf8224f70a3129dc308e67b4f/roles/5339284d849f4b6f868fbb571a22b9e0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:55.328440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50035c14-1e17-4d2c-a405-af626a68288d None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=ac2cabfcf8224f70a3129dc308e67b4f, role_id=5339284d849f4b6f868fbb571a22b9e0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:55.329947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50035c14-1e17-4d2c-a405-af626a68288d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:55.355803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 535/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:46:55 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/ac2cabfcf8224f70a3129dc308e67b4f/roles/5339284d849f4b6f868fbb571a22b9e0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:46:56.833005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5198-45c5-407a-b779-a9553e167932 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:56.833543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5198-45c5-407a-b779-a9553e167932 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:56.833543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5198-45c5-407a-b779-a9553e167932 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:56.835046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 550/1085] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:56.840883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7929f-e590-432d-8eac-f528475c02d9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:56.841323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7929f-e590-432d-8eac-f528475c02d9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:56.841423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7929f-e590-432d-8eac-f528475c02d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:56.861249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-dcb7929f-e590-432d-8eac-f528475c02d9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:56.862435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-dcb7929f-e590-432d-8eac-f528475c02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:56.872463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:56.935104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 536/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:57.199405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5198-45c5-407a-b779-a9553e167932 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:57.264920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:57.304272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5198-45c5-407a-b779-a9553e167932 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:57.337561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:57.338189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:57.338461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:57.338726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:57.348870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:57.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:57.355180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:57.356059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 551/1087] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:57.361853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7929f-e590-432d-8eac-f528475c02d9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:57.471408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7929f-e590-432d-8eac-f528475c02d9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:57.504476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd35566-3261-4565-9787-dd2e4f34083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:57.505078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd35566-3261-4565-9787-dd2e4f34083d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:57.505349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd35566-3261-4565-9787-dd2e4f34083d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:57.505609 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd35566-3261-4565-9787-dd2e4f34083d None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:57.506256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd35566-3261-4565-9787-dd2e4f34083d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:57.506547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd35566-3261-4565-9787-dd2e4f34083d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:57.508365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd35566-3261-4565-9787-dd2e4f34083d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:57.516324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 537/1088] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:57.522528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:57.534449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17478feb-3cd1-4aea-b742-c05070065b89 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:57.534734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17478feb-3cd1-4aea-b742-c05070065b89 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:57.535003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17478feb-3cd1-4aea-b742-c05070065b89 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:57.536704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 538/1089] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:46:57.541608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984fc9-5fea-48d6-830e-439ec21443f8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:57.541865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984fc9-5fea-48d6-830e-439ec21443f8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:57.542135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10984fc9-5fea-48d6-830e-439ec21443f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:57.555562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:57.562068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-10984fc9-5fea-48d6-830e-439ec21443f8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:46:57.563503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-10984fc9-5fea-48d6-830e-439ec21443f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:46:57.626658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d46d-d7b4-40e0-b5d5-c5164e6baa1a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:57.631955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 539/1090] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:46:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:46:57.651113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:57.663369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:57.664034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:57.664307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:57.664572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] PATH_INFO: `/v3/users/b01ccd8183c44c2498b5b105415d99db` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:57.665701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] RBAC: Authorizing `identity:get_user(user_id=b01ccd8183c44c2498b5b105415d99db)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:57.667141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:57.673387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 552/1091] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:46:57 2022] GET /identity/v3/users/b01ccd8183c44c2498b5b105415d99db => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:57.674593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984fc9-5fea-48d6-830e-439ec21443f8 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:57.773954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10984fc9-5fea-48d6-830e-439ec21443f8 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:57.808017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:57.808622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:57.808896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:57.809160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:57.812628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:57.878282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:57.879730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:57.897815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:57.978070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 540/1092] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:46:57.984337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.003211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d0cd5-6c47-4652-b772-1780c9aaaabb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.018556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:58.038822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.039378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.039650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.039956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.050174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:46:58.055542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:58.056499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:58.057430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 553/1093] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Sep 15 12:46:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:58.062650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.085359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc67bc7-1a54-43c7-92b3-9087e891d8aa None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.114295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:58.120608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.121248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.121522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.121797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.122898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] RBAC: Authorizing `identity:get_project(project_id=ba8664899bdc4e138d17b1fa26d9041c)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:58.124371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:58.126014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 541/1094] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:46:57 2022] GET /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:58.132128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.165850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fb363-43f5-4cab-adcf-52e619da6fa4 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.201159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.201761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.202035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.202300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.202947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:58.203241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:58.204652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:58.212932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 554/1095] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Sep 15 12:46:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:58.218840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.231487 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da250ca8-4317-485a-b397-6c8c1c0ebd49 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.234686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:58.266901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.267508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.267819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.268086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.268803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=ba8664899bdc4e138d17b1fa26d9041c, user.id=b01ccd8183c44c2498b5b105415d99db) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:58.269103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:58.270515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:58.279730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 542/1096] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:58 2022] GET /identity/v3/role_assignments?user.id=b01ccd8183c44c2498b5b105415d99db&scope.project.id=ba8664899bdc4e138d17b1fa26d9041c&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:46:58.323414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1a805-1448-433a-b77d-29bbb5751318 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.338146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:58.362531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.363180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.363449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.363733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.375741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:58.377233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:58.392519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:58.393559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:58.394680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:58.394680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:58.394680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:58.394680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 555/1097] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:58.399869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.508581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357607b-573a-493e-8644-af666c6d36dd None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.547239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.547966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.548240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.548502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.549133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:58.549426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:58.550777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:58.562994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 543/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:58.568822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.670700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b143f-523d-46fb-aaca-84e6b5e7dfef None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.705323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.705946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.706189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.706469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.714157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:58.715580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:46:58.727214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:58.728265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:46:58.729628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 556/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Sep 15 12:46:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:58.734597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.763498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:58.835337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee3fcc-80ff-4450-9253-fc344d04f550 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:58.870523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:58.871122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:58.871389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:58.871650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:58.872395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:58.872688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:58.874108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:58.891354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 544/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Sep 15 12:46:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:58.897066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:58.923870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:59.004032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405ccca-7125-4789-8716-0265ab83b185 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:59.039836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:59.040437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:59.040709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:59.040969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:59.109080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:59.110523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:59.134795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:59.212948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 557/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:46:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:46:59.218927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:59.312934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:59.328776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb18902-9ea6-41e6-afc4-ca218d11b071 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:59.363510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:59.364181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:59.364456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:59.364723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:59.374951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:59.376424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:46:59.391177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:59.392188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:46:59.393091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:46:59.393091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:46:59.393091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:59.393091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 545/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:46:59.398251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:59.506182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfb9c4-6b8a-481a-9a44-b91f7a2603fc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:59.531432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:59.543151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:59.543784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:59.544049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:59.544309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:59.544934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:59.545227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:59.546596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:59.558081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 558/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:59.563882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:59.664040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21774e8-af9a-4da6-8392-0b43c30254e3 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:59.697847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:59.698463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:59.698732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:59.698993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:59.705733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:59.707176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:59.708945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:46:59.719794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:46:59.720793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:46:59.722229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 546/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:46:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:46:59.727253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:59.829075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416eff3-4c84-422b-8046-bb06e21c2b37 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:46:59.864416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be27c6-2f81-4407-8182-86648ed788e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:46:59.865027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be27c6-2f81-4407-8182-86648ed788e9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:46:59.865277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be27c6-2f81-4407-8182-86648ed788e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:46:59.865571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be27c6-2f81-4407-8182-86648ed788e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:46:59.866594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be27c6-2f81-4407-8182-86648ed788e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:46:59.866943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be27c6-2f81-4407-8182-86648ed788e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:46:59.868424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be27c6-2f81-4407-8182-86648ed788e9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:46:59.880612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 559/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:46:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:46:59.886849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:46:59.985755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc364d1-95c8-448c-b879-d0613e856111 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:00.019734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aec5a2-4519-473f-8673-dc35d9ebd5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:00.020353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec5a2-4519-473f-8673-dc35d9ebd5ed None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:00.020624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec5a2-4519-473f-8673-dc35d9ebd5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:00.020885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aec5a2-4519-473f-8673-dc35d9ebd5ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:00.021597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aec5a2-4519-473f-8673-dc35d9ebd5ed None admin] RBAC: Adding query filter params (role.id=5339284d849f4b6f868fbb571a22b9e0, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=ac2cabfcf8224f70a3129dc308e67b4f) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:00.021891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aec5a2-4519-473f-8673-dc35d9ebd5ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:00.023361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aec5a2-4519-473f-8673-dc35d9ebd5ed None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:00.029355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 547/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:46:59 2022] GET /identity/v3/role_assignments?user.id=ac2cabfcf8224f70a3129dc308e67b4f&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=5339284d849f4b6f868fbb571a22b9e0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:00.449370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820b0c9-c841-41c3-b548-fe62eb1613e6 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:00.449864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820b0c9-c841-41c3-b548-fe62eb1613e6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:00.449964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820b0c9-c841-41c3-b548-fe62eb1613e6 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:00.451247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 560/1107] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:00.457054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae731-f30e-4257-b85b-158e9849673c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:00.457340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae731-f30e-4257-b85b-158e9849673c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:00.457662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae731-f30e-4257-b85b-158e9849673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:00.477374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-675ae731-f30e-4257-b85b-158e9849673c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:00.478571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-675ae731-f30e-4257-b85b-158e9849673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:00.538090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:00.549753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 548/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:00.832361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820b0c9-c841-41c3-b548-fe62eb1613e6 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:00.881849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:00.938242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820b0c9-c841-41c3-b548-fe62eb1613e6 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:00.974646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f56aef-5df3-4a1e-b9a8-8e9f5dd73edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:00.975878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f56aef-5df3-4a1e-b9a8-8e9f5dd73edd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:00.975878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f56aef-5df3-4a1e-b9a8-8e9f5dd73edd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:00.976108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f56aef-5df3-4a1e-b9a8-8e9f5dd73edd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:00.977138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f56aef-5df3-4a1e-b9a8-8e9f5dd73edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:00.978587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f56aef-5df3-4a1e-b9a8-8e9f5dd73edd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:00.980258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 561/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:47:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:00.989528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ae731-f30e-4257-b85b-158e9849673c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:01.090757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ae731-f30e-4257-b85b-158e9849673c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:01.139919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb51e0-9c2e-40e1-8afa-779a628e702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:01.140521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb51e0-9c2e-40e1-8afa-779a628e702c None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:01.140798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb51e0-9c2e-40e1-8afa-779a628e702c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:01.141068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb51e0-9c2e-40e1-8afa-779a628e702c None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:01.141719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb51e0-9c2e-40e1-8afa-779a628e702c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:01.143185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb51e0-9c2e-40e1-8afa-779a628e702c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:01.166398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 549/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:47:00 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:47:03.334549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553a0e-7258-48c3-865f-650ee04060d2 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:03.335405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553a0e-7258-48c3-865f-650ee04060d2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:03.335864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553a0e-7258-48c3-865f-650ee04060d2 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:03.338248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 562/1111] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:03.344741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755807-9307-46be-99dd-83784107bdda None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:03.345194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755807-9307-46be-99dd-83784107bdda None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:03.345288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755807-9307-46be-99dd-83784107bdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:03.367035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-71755807-9307-46be-99dd-83784107bdda None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:03.368239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-71755807-9307-46be-99dd-83784107bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:03.424551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:03.451594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 550/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:03.717389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7553a0e-7258-48c3-865f-650ee04060d2 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:03.836304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7553a0e-7258-48c3-865f-650ee04060d2 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:03.849251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:03.873778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:03.874397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:03.874665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:03.874927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] PATH_INFO: `/v3/roles/8bb219ecae85425b811774a579941e97` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:03.876434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] RBAC: Authorizing `identity:get_role(role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:03.877794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:03.879086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 563/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:03 2022] GET /identity/v3/roles/8bb219ecae85425b811774a579941e97 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:03.885712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71755807-9307-46be-99dd-83784107bdda None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:03.996801 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71755807-9307-46be-99dd-83784107bdda None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:04.037369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:04.038365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:04.038801 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:04.039429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] PATH_INFO: `/v3/users/6cacd77a30bc455db829b496688806d5` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:04.062361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=6cacd77a30bc455db829b496688806d5)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:04.064388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:04.066988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 551/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:03 2022] GET /identity/v3/users/6cacd77a30bc455db829b496688806d5 => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:04.074722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:04.182589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d8a5-339e-4e11-84ab-43f4fe104391 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:04.220196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:04.220799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:04.221071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:04.221334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:04.271114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:04.292963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:04.294407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:04.407537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 564/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:47:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:47:04.416781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:04.459634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:04.528005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37d724-3fc1-478d-b02a-59873f664ac7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:04.563901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2dfd0-c9cd-44ff-9573-556e852092a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:04.564517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2dfd0-c9cd-44ff-9573-556e852092a6 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:04.564792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2dfd0-c9cd-44ff-9573-556e852092a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:04.565060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2dfd0-c9cd-44ff-9573-556e852092a6 None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:04.566204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2dfd0-c9cd-44ff-9573-556e852092a6 None admin] RBAC: Authorizing `identity:get_project(project_id=ba8664899bdc4e138d17b1fa26d9041c)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:04.567632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2dfd0-c9cd-44ff-9573-556e852092a6 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:04.569914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 552/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:04 2022] GET /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:04.577261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:04.675233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:04.698354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be27efd-5d70-459b-b0e4-e265a0dce887 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:04.734531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a030875-223f-4048-8381-807345f633cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:04.735143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030875-223f-4048-8381-807345f633cc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:04.735410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030875-223f-4048-8381-807345f633cc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:04.735646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030875-223f-4048-8381-807345f633cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:04.736390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a030875-223f-4048-8381-807345f633cc None admin] RBAC: Adding query filter params (role.id=8bb219ecae85425b811774a579941e97, scope.project.id=ba8664899bdc4e138d17b1fa26d9041c, user.id=6cacd77a30bc455db829b496688806d5) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:04.736685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a030875-223f-4048-8381-807345f633cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:04.738146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a030875-223f-4048-8381-807345f633cc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:04.744040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 565/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:47:04 2022] GET /identity/v3/role_assignments?user.id=6cacd77a30bc455db829b496688806d5&scope.project.id=ba8664899bdc4e138d17b1fa26d9041c&role.id=8bb219ecae85425b811774a579941e97 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:06.862776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf108912-c8d7-4666-915a-50c516c73531 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:06.863330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf108912-c8d7-4666-915a-50c516c73531 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:06.863330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf108912-c8d7-4666-915a-50c516c73531 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:06.864671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 553/1118] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:06.870666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1560aa-3710-465c-a543-a0797f4e5e39 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:06.871138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1560aa-3710-465c-a543-a0797f4e5e39 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:06.871138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1560aa-3710-465c-a543-a0797f4e5e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:06.892890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1c1560aa-3710-465c-a543-a0797f4e5e39 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:06.895283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1c1560aa-3710-465c-a543-a0797f4e5e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:06.987912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 566/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:07.259804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf108912-c8d7-4666-915a-50c516c73531 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:07.367571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf108912-c8d7-4666-915a-50c516c73531 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:07.369969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:07.402186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:07.402805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:07.403074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:07.403340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] PATH_INFO: `/v3/roles/8bb219ecae85425b811774a579941e97` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:07.404787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] RBAC: Authorizing `identity:get_role(role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:07.406166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:07.407478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 554/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:07 2022] GET /identity/v3/roles/8bb219ecae85425b811774a579941e97 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:07.413865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1560aa-3710-465c-a543-a0797f4e5e39 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:07.499045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:07.532855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1560aa-3710-465c-a543-a0797f4e5e39 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:07.568630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:07.569258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:07.569528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:07.569791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] PATH_INFO: `/v3/users/6cacd77a30bc455db829b496688806d5` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:07.571004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=6cacd77a30bc455db829b496688806d5)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:07.572463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:07.574030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 567/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:07 2022] GET /identity/v3/users/6cacd77a30bc455db829b496688806d5 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:07.583102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:07.690682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4e08-283f-4e20-b7d8-3689e6fe0b56 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:07.725388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399ad20-aa37-4348-90bb-0f4d030821f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:07.726008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ad20-aa37-4348-90bb-0f4d030821f9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:07.726287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ad20-aa37-4348-90bb-0f4d030821f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:07.726559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ad20-aa37-4348-90bb-0f4d030821f9 None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:07.727808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399ad20-aa37-4348-90bb-0f4d030821f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ba8664899bdc4e138d17b1fa26d9041c)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:07.729237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399ad20-aa37-4348-90bb-0f4d030821f9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:07.730834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 555/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:07 2022] GET /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:07.740308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:07.846543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb92e5d-4adf-43c7-b630-e6ac76cbc3b3 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:07.882990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0829a03-7571-4d95-af1a-d5749f71c408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:07.883595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0829a03-7571-4d95-af1a-d5749f71c408 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:07.883920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0829a03-7571-4d95-af1a-d5749f71c408 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:07.884182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0829a03-7571-4d95-af1a-d5749f71c408 None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c/users/6cacd77a30bc455db829b496688806d5/roles/8bb219ecae85425b811774a579941e97` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:07.886691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0829a03-7571-4d95-af1a-d5749f71c408 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba8664899bdc4e138d17b1fa26d9041c, user_id=6cacd77a30bc455db829b496688806d5, role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:07.888157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0829a03-7571-4d95-af1a-d5749f71c408 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:07.908624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 568/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:47:07 2022] PUT /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c/users/6cacd77a30bc455db829b496688806d5/roles/8bb219ecae85425b811774a579941e97 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:47:10.016947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8d30-6fcf-43f9-817b-47b8d9df93ac None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:10.017845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8d30-6fcf-43f9-817b-47b8d9df93ac None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:10.017845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f8d30-6fcf-43f9-817b-47b8d9df93ac None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:10.020036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 556/1124] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:10.026570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2307-30fb-4415-ac48-c81bdc9f673b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:10.027299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2307-30fb-4415-ac48-c81bdc9f673b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:10.027442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c2307-30fb-4415-ac48-c81bdc9f673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:10.038420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:10.051427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-ba8c2307-30fb-4415-ac48-c81bdc9f673b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:10.052671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ba8c2307-30fb-4415-ac48-c81bdc9f673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:10.131981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 569/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:10.406890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8d30-6fcf-43f9-817b-47b8d9df93ac None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:10.462007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:10.525180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f8d30-6fcf-43f9-817b-47b8d9df93ac None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:10.560408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:10.561031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:10.561307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:10.561574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] PATH_INFO: `/v3/roles/8bb219ecae85425b811774a579941e97` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:10.563072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] RBAC: Authorizing `identity:get_role(role_id=8bb219ecae85425b811774a579941e97)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:10.564489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:10.565831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 557/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:10 2022] GET /identity/v3/roles/8bb219ecae85425b811774a579941e97 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:10.572281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c2307-30fb-4415-ac48-c81bdc9f673b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:10.690497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c2307-30fb-4415-ac48-c81bdc9f673b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:10.721137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:10.727245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:10.727909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:10.728181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:10.728428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] PATH_INFO: `/v3/users/6cacd77a30bc455db829b496688806d5` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:10.729567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] RBAC: Authorizing `identity:get_user(user_id=6cacd77a30bc455db829b496688806d5)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:10.731009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:10.732968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 570/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:10 2022] GET /identity/v3/users/6cacd77a30bc455db829b496688806d5 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:10.738993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:10.843309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468e58-8bfa-45d0-95d4-f6273d771e39 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:10.852187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:10.879355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:10.879980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:10.880260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:10.880528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:10.955346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:10.956769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:11.056849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 558/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:47:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:47:11.066369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:11.181344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129af0de-d1a6-43a4-9048-32df3ad27434 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:11.218872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bde0a-9234-48aa-9d3f-1563329cd88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:11.219446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bde0a-9234-48aa-9d3f-1563329cd88b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:11.219722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bde0a-9234-48aa-9d3f-1563329cd88b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:11.219986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bde0a-9234-48aa-9d3f-1563329cd88b None admin] PATH_INFO: `/v3/projects/ba8664899bdc4e138d17b1fa26d9041c` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:11.221120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bde0a-9234-48aa-9d3f-1563329cd88b None admin] RBAC: Authorizing `identity:get_project(project_id=ba8664899bdc4e138d17b1fa26d9041c)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:11.222548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bde0a-9234-48aa-9d3f-1563329cd88b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:11.224196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 571/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:11 2022] GET /identity/v3/projects/ba8664899bdc4e138d17b1fa26d9041c => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:11.230649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:11.241498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:11.334183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d195749-1087-4e86-9e40-b2043e52a980 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:11.369495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a129ec-392c-42cd-a42b-9cc096789300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:11.370088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a129ec-392c-42cd-a42b-9cc096789300 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:11.370358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a129ec-392c-42cd-a42b-9cc096789300 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:11.370619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a129ec-392c-42cd-a42b-9cc096789300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:11.371325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a129ec-392c-42cd-a42b-9cc096789300 None admin] RBAC: Adding query filter params (role.id=8bb219ecae85425b811774a579941e97, scope.project.id=ba8664899bdc4e138d17b1fa26d9041c, user.id=6cacd77a30bc455db829b496688806d5) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:11.371626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a129ec-392c-42cd-a42b-9cc096789300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:11.373069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a129ec-392c-42cd-a42b-9cc096789300 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:11.378806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 559/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:47:11 2022] GET /identity/v3/role_assignments?user.id=6cacd77a30bc455db829b496688806d5&scope.project.id=ba8664899bdc4e138d17b1fa26d9041c&role.id=8bb219ecae85425b811774a579941e97 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:13.638967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81d3b2-2402-4855-b09f-45bc3fc97a1d None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:13.639523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81d3b2-2402-4855-b09f-45bc3fc97a1d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:13.639523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81d3b2-2402-4855-b09f-45bc3fc97a1d None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:13.640858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 572/1131] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:13.647552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbf67f-10e6-464f-bc60-1080c575d6d5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:13.648308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbf67f-10e6-464f-bc60-1080c575d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:13.648499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbf67f-10e6-464f-bc60-1080c575d6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:13.672311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-72fbf67f-10e6-464f-bc60-1080c575d6d5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:13.673493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-72fbf67f-10e6-464f-bc60-1080c575d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:13.741958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 560/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:14.003775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81d3b2-2402-4855-b09f-45bc3fc97a1d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:14.088958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:14.124575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81d3b2-2402-4855-b09f-45bc3fc97a1d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:14.159778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9f370-93f8-448a-8ee1-830ad273e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:14.160391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f370-93f8-448a-8ee1-830ad273e2fc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:14.160659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f370-93f8-448a-8ee1-830ad273e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:14.160918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9f370-93f8-448a-8ee1-830ad273e2fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:14.162195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9f370-93f8-448a-8ee1-830ad273e2fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:14.163522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9f370-93f8-448a-8ee1-830ad273e2fc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:14.165092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 573/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:14.174375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbf67f-10e6-464f-bc60-1080c575d6d5 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:14.177897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:14.278616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbf67f-10e6-464f-bc60-1080c575d6d5 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:14.313954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469073e7-1814-4564-8c37-3e69c316ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:14.314557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469073e7-1814-4564-8c37-3e69c316ad05 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:14.314831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469073e7-1814-4564-8c37-3e69c316ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:14.315097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469073e7-1814-4564-8c37-3e69c316ad05 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:14.315739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469073e7-1814-4564-8c37-3e69c316ad05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:14.317195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469073e7-1814-4564-8c37-3e69c316ad05 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:14.348516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 561/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:47:14 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:47:16.543584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f421d-43c6-44d4-b156-035492f7b5d2 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:16.544522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f421d-43c6-44d4-b156-035492f7b5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:16.544522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f421d-43c6-44d4-b156-035492f7b5d2 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:16.546637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 574/1135] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:16.555051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca6e3f-bd11-43a7-b5c2-5fa5c5b5fc93 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:16.555498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca6e3f-bd11-43a7-b5c2-5fa5c5b5fc93 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:16.555590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca6e3f-bd11-43a7-b5c2-5fa5c5b5fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:16.575331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2dca6e3f-bd11-43a7-b5c2-5fa5c5b5fc93 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:16.576522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2dca6e3f-bd11-43a7-b5c2-5fa5c5b5fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:16.641325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:16.660286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 562/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:47:16.935414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f421d-43c6-44d4-b156-035492f7b5d2 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:17.043720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f421d-43c6-44d4-b156-035492f7b5d2 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:17.084830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15040e2-ca34-4f17-a5b9-2a6704d15875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:17.085456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15040e2-ca34-4f17-a5b9-2a6704d15875 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:17.085731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15040e2-ca34-4f17-a5b9-2a6704d15875 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:17.085994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15040e2-ca34-4f17-a5b9-2a6704d15875 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:17.087162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15040e2-ca34-4f17-a5b9-2a6704d15875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:17.088641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15040e2-ca34-4f17-a5b9-2a6704d15875 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:17.090212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 575/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:47:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:17.099380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca6e3f-bd11-43a7-b5c2-5fa5c5b5fc93 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:17.208573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca6e3f-bd11-43a7-b5c2-5fa5c5b5fc93 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:17.245495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cfa1c-7944-417b-86ee-f56722c3e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:17.246100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cfa1c-7944-417b-86ee-f56722c3e751 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:17.246374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cfa1c-7944-417b-86ee-f56722c3e751 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:17.246641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cfa1c-7944-417b-86ee-f56722c3e751 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:17.247284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cfa1c-7944-417b-86ee-f56722c3e751 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:17.248756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cfa1c-7944-417b-86ee-f56722c3e751 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:17.274475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 563/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:47:17 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:47:19.436585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502faaf8-c44b-47b3-a43d-bfb450746b97 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:19.437167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502faaf8-c44b-47b3-a43d-bfb450746b97 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:19.437167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502faaf8-c44b-47b3-a43d-bfb450746b97 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:19.438434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 576/1139] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:47:19.447228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045cf7f-d4ad-4c45-a524-0f4e0e38620e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:19.447635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045cf7f-d4ad-4c45-a524-0f4e0e38620e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:19.447810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045cf7f-d4ad-4c45-a524-0f4e0e38620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:19.470967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-1045cf7f-d4ad-4c45-a524-0f4e0e38620e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:19.472212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1045cf7f-d4ad-4c45-a524-0f4e0e38620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:19.509233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:19.544563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 564/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:19.809548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502faaf8-c44b-47b3-a43d-bfb450746b97 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:19.815912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:19.919516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502faaf8-c44b-47b3-a43d-bfb450746b97 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:19.954289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:19.954899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:19.955172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:19.955435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:19.966544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:47:19.971356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:47:19.972406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:47:19.973562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 577/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:47:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:47:19.980656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045cf7f-d4ad-4c45-a524-0f4e0e38620e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:20.084881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045cf7f-d4ad-4c45-a524-0f4e0e38620e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:20.124265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:20.124863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:20.125137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:20.125399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:20.126057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:20.126356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:20.127744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:20.136716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 565/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:47:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:20.143591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:20.218239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:20.258220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961a759-ab37-4899-b7fc-e56691fe54f6 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:20.292906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:20.293517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:20.293784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:20.294047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] PATH_INFO: `/v3/users/4e9e86afcecf483b927b2e86c858e0e3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:20.309035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] RBAC: Authorizing `identity:get_user(user_id=4e9e86afcecf483b927b2e86c858e0e3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:20.310473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:20.312053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 578/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:20 2022] GET /identity/v3/users/4e9e86afcecf483b927b2e86c858e0e3 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:20.321140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:20.360778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:20.431872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bf1cf-bba5-4ca2-b80b-f07357cd5c58 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:20.470707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:20.471315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:20.471589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:20.471891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:20.540441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:20.541871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:20.572550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:20.653577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 566/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:47:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:47:20.659916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:20.767561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c2fbe-b90f-4431-ae91-66173bd3343a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:20.790933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:20.803902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9dd3-201c-4dc4-9be4-9f74db2bf478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:20.804520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9dd3-201c-4dc4-9be4-9f74db2bf478 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:20.804795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9dd3-201c-4dc4-9be4-9f74db2bf478 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:20.805053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9dd3-201c-4dc4-9be4-9f74db2bf478 None admin] PATH_INFO: `/v3/projects/006ccca54d184b6f8ea0aec9a4b14080` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:20.806288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9dd3-201c-4dc4-9be4-9f74db2bf478 None admin] RBAC: Authorizing `identity:get_project(project_id=006ccca54d184b6f8ea0aec9a4b14080)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:20.807724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9dd3-201c-4dc4-9be4-9f74db2bf478 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:20.809387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 579/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:20 2022] GET /identity/v3/projects/006ccca54d184b6f8ea0aec9a4b14080 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:20.816159 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:20.932242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed132bbc-5355-4d5d-9e72-bcd43899a883 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:20.973382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:20.979561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efc0fb-2234-475f-aedc-f3df2c34a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:20.980185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc0fb-2234-475f-aedc-f3df2c34a71a None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:20.980455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc0fb-2234-475f-aedc-f3df2c34a71a None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:20.980715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efc0fb-2234-475f-aedc-f3df2c34a71a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:20.981787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc0fb-2234-475f-aedc-f3df2c34a71a None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=006ccca54d184b6f8ea0aec9a4b14080, user.id=4e9e86afcecf483b927b2e86c858e0e3) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:20.982077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc0fb-2234-475f-aedc-f3df2c34a71a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:20.983482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efc0fb-2234-475f-aedc-f3df2c34a71a None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:20.988825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 567/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:47:20 2022] GET /identity/v3/role_assignments?user.id=4e9e86afcecf483b927b2e86c858e0e3&scope.project.id=006ccca54d184b6f8ea0aec9a4b14080&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:23.086847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd994c7-03a8-4d19-b8ac-ebec41336881 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:23.087743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd994c7-03a8-4d19-b8ac-ebec41336881 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:23.087743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd994c7-03a8-4d19-b8ac-ebec41336881 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:23.089935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 580/1147] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:23.095266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24289-3b0a-409c-8d49-5d8309df5226 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:23.095691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24289-3b0a-409c-8d49-5d8309df5226 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:23.095827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b24289-3b0a-409c-8d49-5d8309df5226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:23.116134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-10b24289-3b0a-409c-8d49-5d8309df5226 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:23.117272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-10b24289-3b0a-409c-8d49-5d8309df5226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:23.184766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 568/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:23.453545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd994c7-03a8-4d19-b8ac-ebec41336881 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:23.560432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd994c7-03a8-4d19-b8ac-ebec41336881 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:23.596265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:23.596910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:23.597185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:23.597454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:23.609008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:47:23.613872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:47:23.614935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:47:23.615999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 581/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:47:23.621987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24289-3b0a-409c-8d49-5d8309df5226 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:23.721417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b24289-3b0a-409c-8d49-5d8309df5226 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:23.750314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:23.760249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:23.760847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:23.761121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:23.761363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:23.762002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:23.762292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:23.763646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:23.771592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 569/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:23.777580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:23.832459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:23.884116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e26b6-d4f8-4338-9df9-d0c28aa861eb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:23.927529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:23.928648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:23.928891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:23.929152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] PATH_INFO: `/v3/users/4e9e86afcecf483b927b2e86c858e0e3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:23.930390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] RBAC: Authorizing `identity:get_user(user_id=4e9e86afcecf483b927b2e86c858e0e3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:23.931857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:23.933421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 582/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:23 2022] GET /identity/v3/users/4e9e86afcecf483b927b2e86c858e0e3 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:23.939308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:24.045227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d8875-4a15-4f37-81cc-590b68fbabe4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:24.080763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9f73-d4e4-41d4-9d33-477a34742ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:24.081385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9f73-d4e4-41d4-9d33-477a34742ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:24.081657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9f73-d4e4-41d4-9d33-477a34742ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:24.081920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9f73-d4e4-41d4-9d33-477a34742ec3 None admin] PATH_INFO: `/v3/projects/006ccca54d184b6f8ea0aec9a4b14080` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:24.083032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9f73-d4e4-41d4-9d33-477a34742ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=006ccca54d184b6f8ea0aec9a4b14080)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:24.084536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a9f73-d4e4-41d4-9d33-477a34742ec3 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:24.086168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 570/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:23 2022] GET /identity/v3/projects/006ccca54d184b6f8ea0aec9a4b14080 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:24.092355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:24.206164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af19f22-54f2-422c-b464-22847087f307 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:24.223482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:24.243375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf58206-3ee8-4313-a8c8-1ca8411c7006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:24.244066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58206-3ee8-4313-a8c8-1ca8411c7006 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:24.244342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58206-3ee8-4313-a8c8-1ca8411c7006 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:24.244612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58206-3ee8-4313-a8c8-1ca8411c7006 None admin] PATH_INFO: `/v3/projects/006ccca54d184b6f8ea0aec9a4b14080/users/4e9e86afcecf483b927b2e86c858e0e3/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:24.246771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf58206-3ee8-4313-a8c8-1ca8411c7006 None admin] RBAC: Authorizing `identity:create_grant(project_id=006ccca54d184b6f8ea0aec9a4b14080, user_id=4e9e86afcecf483b927b2e86c858e0e3, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:24.248270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf58206-3ee8-4313-a8c8-1ca8411c7006 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:24.266843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 583/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:47:24 2022] PUT /identity/v3/projects/006ccca54d184b6f8ea0aec9a4b14080/users/4e9e86afcecf483b927b2e86c858e0e3/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:47:26.367453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a653fd-3cda-4dfe-8bcf-e22aeaead4b6 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:26.368139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a653fd-3cda-4dfe-8bcf-e22aeaead4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:26.368139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a653fd-3cda-4dfe-8bcf-e22aeaead4b6 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:26.369371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 571/1154] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:47:26.375659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a31b-09b6-4112-ab4a-ba9f0fc532c7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:26.376400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a31b-09b6-4112-ab4a-ba9f0fc532c7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:26.376595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619a31b-09b6-4112-ab4a-ba9f0fc532c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:26.397923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9619a31b-09b6-4112-ab4a-ba9f0fc532c7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:26.399108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9619a31b-09b6-4112-ab4a-ba9f0fc532c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:26.474342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 584/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:26.739642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a653fd-3cda-4dfe-8bcf-e22aeaead4b6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:26.808135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:26.865271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a653fd-3cda-4dfe-8bcf-e22aeaead4b6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:26.903887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:26.904518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:26.904796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:26.905071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:26.915286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:47:26.920196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:47:26.921211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:47:26.922149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 572/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:47:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:47:26.928164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619a31b-09b6-4112-ab4a-ba9f0fc532c7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:27.029337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619a31b-09b6-4112-ab4a-ba9f0fc532c7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:27.038399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:27.064954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:27.065555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:27.065836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:27.066077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:27.066757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:27.067057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:27.068711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:27.077391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 585/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:27.083591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:27.189507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91465bc7-3d63-43ea-bf60-50a9f6e2e009 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:27.209597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:27.228431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:27.229055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:27.229329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:27.229595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] PATH_INFO: `/v3/users/4e9e86afcecf483b927b2e86c858e0e3` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:27.231040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] RBAC: Authorizing `identity:get_user(user_id=4e9e86afcecf483b927b2e86c858e0e3)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:27.232499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:27.234068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 573/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:27 2022] GET /identity/v3/users/4e9e86afcecf483b927b2e86c858e0e3 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:47:27.240017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:27.344355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ffc40-292a-42f0-87a4-86bea5ca86ff None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:27.379688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:27.380307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:27.380667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:27.381081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:27.438573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:27.467937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:27.469387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:27.572269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 586/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:47:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:47:27.582150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:27.688791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe8734-f659-4c36-8080-1288c2f77b4b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:27.731511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafec5b-7c1a-4032-9799-3062d6c98024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:27.732409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafec5b-7c1a-4032-9799-3062d6c98024 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:27.732751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafec5b-7c1a-4032-9799-3062d6c98024 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:27.733104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafec5b-7c1a-4032-9799-3062d6c98024 None admin] PATH_INFO: `/v3/projects/006ccca54d184b6f8ea0aec9a4b14080` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:27.734915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafec5b-7c1a-4032-9799-3062d6c98024 None admin] RBAC: Authorizing `identity:get_project(project_id=006ccca54d184b6f8ea0aec9a4b14080)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:27.737180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafec5b-7c1a-4032-9799-3062d6c98024 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:27.739655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 574/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:27 2022] GET /identity/v3/projects/006ccca54d184b6f8ea0aec9a4b14080 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:27.745970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:27.815197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:27.846673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b488-70d9-47eb-b7f6-e387cb9edc9a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:27.882200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8c7c9-4ccc-4866-878c-010227879546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:27.882785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8c7c9-4ccc-4866-878c-010227879546 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:27.883050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8c7c9-4ccc-4866-878c-010227879546 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:27.883309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8c7c9-4ccc-4866-878c-010227879546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:27.884057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8c7c9-4ccc-4866-878c-010227879546 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=006ccca54d184b6f8ea0aec9a4b14080, user.id=4e9e86afcecf483b927b2e86c858e0e3) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:27.884352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8c7c9-4ccc-4866-878c-010227879546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:27.885773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8c7c9-4ccc-4866-878c-010227879546 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:27.891582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 587/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:47:27 2022] GET /identity/v3/role_assignments?user.id=4e9e86afcecf483b927b2e86c858e0e3&scope.project.id=006ccca54d184b6f8ea0aec9a4b14080&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:30.047583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e9c4-3906-4752-85a1-346e903a21f2 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:30.048551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e9c4-3906-4752-85a1-346e903a21f2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:30.048551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e9c4-3906-4752-85a1-346e903a21f2 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:30.050715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 575/1162] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:30.056444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647597d9-fa90-47b5-80be-e129a437d74d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:30.056878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647597d9-fa90-47b5-80be-e129a437d74d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:30.056982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647597d9-fa90-47b5-80be-e129a437d74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:30.076617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-647597d9-fa90-47b5-80be-e129a437d74d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:30.077786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-647597d9-fa90-47b5-80be-e129a437d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:30.162592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 588/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:30.439283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4e9c4-3906-4752-85a1-346e903a21f2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:30.509282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:30.558166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4e9c4-3906-4752-85a1-346e903a21f2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:30.592992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:30.593590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:30.593870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:30.594134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:30.669052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:30.670499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:30.723316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:30.777281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 576/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:47:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:47:30.786245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647597d9-fa90-47b5-80be-e129a437d74d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:30.856144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:30.894964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647597d9-fa90-47b5-80be-e129a437d74d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:30.930275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a85414-1f1e-483f-b14a-5d26dba11447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:30.930894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85414-1f1e-483f-b14a-5d26dba11447 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:30.931158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85414-1f1e-483f-b14a-5d26dba11447 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:30.931414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85414-1f1e-483f-b14a-5d26dba11447 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:30.938720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a85414-1f1e-483f-b14a-5d26dba11447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:30.940186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a85414-1f1e-483f-b14a-5d26dba11447 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c3a85414-1f1e-483f-b14a-5d26dba11447 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:47:30.951825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:47:30.952900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:47:30.953809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 589/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:47:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:47:30.961190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:31.072364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e672c7-41d3-4096-8985-0354c60b450d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:31.108272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248ee73-c2dc-4121-90fa-be8d0d858ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:31.108865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ee73-c2dc-4121-90fa-be8d0d858ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:31.109134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ee73-c2dc-4121-90fa-be8d0d858ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:31.109396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ee73-c2dc-4121-90fa-be8d0d858ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:31.110021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248ee73-c2dc-4121-90fa-be8d0d858ce8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:31.110309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248ee73-c2dc-4121-90fa-be8d0d858ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:31.111681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248ee73-c2dc-4121-90fa-be8d0d858ce8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:31.118864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 577/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Sep 15 12:47:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:33.246393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f64d-e958-4a89-9784-b0d15ae356d4 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:33.247300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f64d-e958-4a89-9784-b0d15ae356d4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:33.247300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f64d-e958-4a89-9784-b0d15ae356d4 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:33.249507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 590/1167] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:33.256397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040027c5-a8c2-477b-b360-fc4a1682e3c6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:33.257377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040027c5-a8c2-477b-b360-fc4a1682e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:33.257377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040027c5-a8c2-477b-b360-fc4a1682e3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:33.276165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-040027c5-a8c2-477b-b360-fc4a1682e3c6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:33.277335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-040027c5-a8c2-477b-b360-fc4a1682e3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:33.288524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:33.360174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 578/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:33.642961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f64d-e958-4a89-9784-b0d15ae356d4 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:33.758036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f64d-e958-4a89-9784-b0d15ae356d4 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:33.788023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:33.801489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5392d-dfec-42b8-b853-8949f0cf6e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:33.802104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5392d-dfec-42b8-b853-8949f0cf6e7f None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:33.802372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5392d-dfec-42b8-b853-8949f0cf6e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:33.802630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5392d-dfec-42b8-b853-8949f0cf6e7f None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:33.803298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5392d-dfec-42b8-b853-8949f0cf6e7f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:33.804854 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5392d-dfec-42b8-b853-8949f0cf6e7f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:33.830203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 591/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Sep 15 12:47:33 2022] POST /identity/v3/domains => generated 267 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:47:35.996137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2c4e-155a-4f87-b16a-a2a72dfd1295 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:35.996701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2c4e-155a-4f87-b16a-a2a72dfd1295 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:35.996701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b2c4e-155a-4f87-b16a-a2a72dfd1295 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:35.998054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 579/1170] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:36.004455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf777c-c7c0-44b4-8e13-6c5f49562657 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:36.005212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf777c-c7c0-44b4-8e13-6c5f49562657 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:36.005335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf777c-c7c0-44b4-8e13-6c5f49562657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:36.031274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-fadf777c-c7c0-44b4-8e13-6c5f49562657 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:36.032489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fadf777c-c7c0-44b4-8e13-6c5f49562657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:36.104137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 592/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:36.370634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b2c4e-155a-4f87-b16a-a2a72dfd1295 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:36.487242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b2c4e-155a-4f87-b16a-a2a72dfd1295 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:36.524328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa2db3-752a-4517-9b09-7ccf4658fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:36.524943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa2db3-752a-4517-9b09-7ccf4658fa5b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:36.525214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa2db3-752a-4517-9b09-7ccf4658fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:36.525477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa2db3-752a-4517-9b09-7ccf4658fa5b None admin] PATH_INFO: `/v3/domains/3d41991dc6844b3f8e126d418348ab72` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:36.536007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa2db3-752a-4517-9b09-7ccf4658fa5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=3d41991dc6844b3f8e126d418348ab72)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:36.537437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa2db3-752a-4517-9b09-7ccf4658fa5b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:36.539036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 580/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Sep 15 12:47:36 2022] GET /identity/v3/domains/3d41991dc6844b3f8e126d418348ab72 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:36.547843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf777c-c7c0-44b4-8e13-6c5f49562657 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:36.649725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf777c-c7c0-44b4-8e13-6c5f49562657 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:36.663985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:36.693350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f9570-dc09-4b17-ac0e-347bf3fa12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:36.693953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f9570-dc09-4b17-ac0e-347bf3fa12ca None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:36.694202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f9570-dc09-4b17-ac0e-347bf3fa12ca None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:36.695066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f9570-dc09-4b17-ac0e-347bf3fa12ca None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:36.695728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f9570-dc09-4b17-ac0e-347bf3fa12ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:36.697189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f9570-dc09-4b17-ac0e-347bf3fa12ca None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:36.733712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 593/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:47:36 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:47:38.917275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d37191-5591-4d84-9eec-690ea154b6aa None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:38.918122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d37191-5591-4d84-9eec-690ea154b6aa None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:38.918122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d37191-5591-4d84-9eec-690ea154b6aa None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:38.920390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 581/1174] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:38.926768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67cc7f-5e00-4010-aeba-2e4635399f47 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:38.927194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67cc7f-5e00-4010-aeba-2e4635399f47 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:38.927304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67cc7f-5e00-4010-aeba-2e4635399f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:38.955328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5a67cc7f-5e00-4010-aeba-2e4635399f47 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:38.957212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5a67cc7f-5e00-4010-aeba-2e4635399f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:39.052795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 594/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:39.325963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d37191-5591-4d84-9eec-690ea154b6aa None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:39.341647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:39.452810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d37191-5591-4d84-9eec-690ea154b6aa None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:39.487571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bc83c-adaf-44ce-91a9-43340196eb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:39.488210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bc83c-adaf-44ce-91a9-43340196eb37 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:39.488478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bc83c-adaf-44ce-91a9-43340196eb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:39.488737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bc83c-adaf-44ce-91a9-43340196eb37 None admin] PATH_INFO: `/v3/domains/3d41991dc6844b3f8e126d418348ab72` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:39.489939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bc83c-adaf-44ce-91a9-43340196eb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3d41991dc6844b3f8e126d418348ab72)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:39.491582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bc83c-adaf-44ce-91a9-43340196eb37 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:39.493163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 582/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Sep 15 12:47:39 2022] GET /identity/v3/domains/3d41991dc6844b3f8e126d418348ab72 => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:39.501718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67cc7f-5e00-4010-aeba-2e4635399f47 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:39.597574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:39.604704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67cc7f-5e00-4010-aeba-2e4635399f47 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:39.641191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f66995-d45f-46c8-849d-73ff82de8ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:39.641782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66995-d45f-46c8-849d-73ff82de8ac0 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:39.642054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66995-d45f-46c8-849d-73ff82de8ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:39.642295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66995-d45f-46c8-849d-73ff82de8ac0 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:39.642940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f66995-d45f-46c8-849d-73ff82de8ac0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:39.644401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f66995-d45f-46c8-849d-73ff82de8ac0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:39.669501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 595/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:47:39 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:47:41.834186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef03033-5a39-4308-93b4-72d658f95e5a None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:41.834757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef03033-5a39-4308-93b4-72d658f95e5a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:41.834757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef03033-5a39-4308-93b4-72d658f95e5a None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:41.837105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 583/1178] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:41.846035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd1e2-4c16-42b5-95c5-905e46a1935f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:41.846435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd1e2-4c16-42b5-95c5-905e46a1935f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:41.846623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd1e2-4c16-42b5-95c5-905e46a1935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:41.874483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-02cfd1e2-4c16-42b5-95c5-905e46a1935f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:41.875657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-02cfd1e2-4c16-42b5-95c5-905e46a1935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:41.945952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 596/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:42.213644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef03033-5a39-4308-93b4-72d658f95e5a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:42.315195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:42.342880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef03033-5a39-4308-93b4-72d658f95e5a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:42.380522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:42.381145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:42.381639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:42.382107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:42.392800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:47:42.397653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:47:42.398732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:42.399752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:47:42.403736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 584/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:47:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:47:42.405470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfd1e2-4c16-42b5-95c5-905e46a1935f None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:42.494557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:42.524744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfd1e2-4c16-42b5-95c5-905e46a1935f None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:42.561178 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:42.561777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:42.562050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:42.562307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:42.562953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:42.563249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:42.564648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:42.572910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 597/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:47:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:42.579299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:42.702818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191df241-a76d-49d5-8c20-c78532727685 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:42.748962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:42.749542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:42.749833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:42.750075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] PATH_INFO: `/v3/users/be6d499cdc124bb9beef73ce61851609` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:42.752179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:42.763599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] RBAC: Authorizing `identity:get_user(user_id=be6d499cdc124bb9beef73ce61851609)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:42.765083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:42.766724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 585/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:42 2022] GET /identity/v3/users/be6d499cdc124bb9beef73ce61851609 => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:42.775138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:42.882010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd44549-9f8f-42fb-a111-012bbf7de205 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:42.920039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:42.920637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:42.920915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:42.921180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:42.937196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:42.995043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:42.996523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:43.121616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 598/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:47:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:47:43.128089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:43.237571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac42e-2db5-42de-8b9f-81163b89e94e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:43.274315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a255bfe-a189-4bfc-80f7-513792f8c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:43.274940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a255bfe-a189-4bfc-80f7-513792f8c40f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:43.275210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a255bfe-a189-4bfc-80f7-513792f8c40f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:43.275473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a255bfe-a189-4bfc-80f7-513792f8c40f None admin] PATH_INFO: `/v3/projects/93441d241b784cb0a841952cb628cbf0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:43.276821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a255bfe-a189-4bfc-80f7-513792f8c40f None admin] RBAC: Authorizing `identity:get_project(project_id=93441d241b784cb0a841952cb628cbf0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:43.278264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a255bfe-a189-4bfc-80f7-513792f8c40f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:43.279955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 586/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:43 2022] GET /identity/v3/projects/93441d241b784cb0a841952cb628cbf0 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:43.286442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:43.338236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:43.416904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee639-269c-4310-be23-c8dbf4ccad27 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:43.452712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3ab11-72e4-4481-9dfb-4d34f7581ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:43.453322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ab11-72e4-4481-9dfb-4d34f7581ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:43.453595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ab11-72e4-4481-9dfb-4d34f7581ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:43.453871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3ab11-72e4-4481-9dfb-4d34f7581ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:43.454577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ab11-72e4-4481-9dfb-4d34f7581ec9 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=93441d241b784cb0a841952cb628cbf0, user.id=be6d499cdc124bb9beef73ce61851609) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:43.454872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ab11-72e4-4481-9dfb-4d34f7581ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:43.456330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3ab11-72e4-4481-9dfb-4d34f7581ec9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:43.462311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 599/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:47:43 2022] GET /identity/v3/role_assignments?user.id=be6d499cdc124bb9beef73ce61851609&scope.project.id=93441d241b784cb0a841952cb628cbf0&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:45.588822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e834cd2-5030-4148-9cf7-c868fd5422de None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:45.589727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e834cd2-5030-4148-9cf7-c868fd5422de None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:45.589727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e834cd2-5030-4148-9cf7-c868fd5422de None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:45.591857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 587/1186] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:45.599745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae3c6-0b7d-47d0-acf8-1b9857d3da38 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:45.600186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae3c6-0b7d-47d0-acf8-1b9857d3da38 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:45.600283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ae3c6-0b7d-47d0-acf8-1b9857d3da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:45.620748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b68ae3c6-0b7d-47d0-acf8-1b9857d3da38 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:45.621934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b68ae3c6-0b7d-47d0-acf8-1b9857d3da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:45.694242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 600/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:47:45.966630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e834cd2-5030-4148-9cf7-c868fd5422de None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:46.033410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:46.077253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e834cd2-5030-4148-9cf7-c868fd5422de None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:46.113454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:46.114460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:46.114844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:46.115256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:46.132914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:47:46.137739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:47:46.138828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:47:46.139674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 588/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:47:46.145000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ae3c6-0b7d-47d0-acf8-1b9857d3da38 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:46.186079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:46.250388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ae3c6-0b7d-47d0-acf8-1b9857d3da38 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:46.285785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:46.286379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:46.286648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:46.286905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:46.287607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:46.287958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:46.289285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:46.297244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 601/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:46.306044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:46.423530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1307-303a-47cb-af47-65545dc6b11d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:46.448687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:46.460576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:46.461231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:46.461518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:46.461786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] PATH_INFO: `/v3/users/be6d499cdc124bb9beef73ce61851609` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:46.463106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] RBAC: Authorizing `identity:get_user(user_id=be6d499cdc124bb9beef73ce61851609)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:46.464578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:46.466160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 589/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:46 2022] GET /identity/v3/users/be6d499cdc124bb9beef73ce61851609 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:46.472305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:46.575980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:46.579051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34b98-caf7-4dcd-86e3-3879f4aacc1e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:46.615993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1607bb-1c7f-4986-9e90-72e02035d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:46.616725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1607bb-1c7f-4986-9e90-72e02035d7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:46.616998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1607bb-1c7f-4986-9e90-72e02035d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:46.617261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1607bb-1c7f-4986-9e90-72e02035d7c4 None admin] PATH_INFO: `/v3/projects/93441d241b784cb0a841952cb628cbf0` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:46.618404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1607bb-1c7f-4986-9e90-72e02035d7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=93441d241b784cb0a841952cb628cbf0)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:46.619862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1607bb-1c7f-4986-9e90-72e02035d7c4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:46.621468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 602/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:46 2022] GET /identity/v3/projects/93441d241b784cb0a841952cb628cbf0 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:46.631312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:46.745340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f169-7589-4c1e-a0ba-6ab696359b9d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:46.781406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7037-cdb2-4571-980b-c0adbd810225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:46.782057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7037-cdb2-4571-980b-c0adbd810225 None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:46.782326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7037-cdb2-4571-980b-c0adbd810225 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:46.782592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7037-cdb2-4571-980b-c0adbd810225 None admin] PATH_INFO: `/v3/projects/93441d241b784cb0a841952cb628cbf0/users/be6d499cdc124bb9beef73ce61851609/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:46.784569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7037-cdb2-4571-980b-c0adbd810225 None admin] RBAC: Authorizing `identity:create_grant(project_id=93441d241b784cb0a841952cb628cbf0, user_id=be6d499cdc124bb9beef73ce61851609, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:46.785988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7037-cdb2-4571-980b-c0adbd810225 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:46.805952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 590/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:47:46 2022] PUT /identity/v3/projects/93441d241b784cb0a841952cb628cbf0/users/be6d499cdc124bb9beef73ce61851609/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:47:48.934974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6368-c77a-4034-a878-8259cd51ec9c None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:48.935546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6368-c77a-4034-a878-8259cd51ec9c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:48.935546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c6368-c77a-4034-a878-8259cd51ec9c None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:48.937609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 603/1193] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:47:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:47:48.946075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326235e-6e29-4b32-9a97-c911c2d0e08a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:48.946458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326235e-6e29-4b32-9a97-c911c2d0e08a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:48.946707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326235e-6e29-4b32-9a97-c911c2d0e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:48.979252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-1326235e-6e29-4b32-9a97-c911c2d0e08a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:47:48.980832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1326235e-6e29-4b32-9a97-c911c2d0e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:47:49.028400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:49.052679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 591/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:47:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:47:49.322896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c6368-c77a-4034-a878-8259cd51ec9c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:49.452495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c6368-c77a-4034-a878-8259cd51ec9c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:49.488657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:49.489272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:49.489539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:49.489796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:49.500711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:47:49.505519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:47:49.506795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:47:49.507826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 604/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:47:49.513294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326235e-6e29-4b32-9a97-c911c2d0e08a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:49.616179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326235e-6e29-4b32-9a97-c911c2d0e08a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:49.652259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:49.652859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:49.653128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:49.653390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:49.654045 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:49.654340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:49.655734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:49.663811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 592/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:49.669977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:49.700789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:49.784936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cb056-3a8e-495d-8d38-d782b940b45b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:49.819630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:49.820270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:49.820539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:49.820801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] PATH_INFO: `/v3/users/be6d499cdc124bb9beef73ce61851609` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:49.821940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] RBAC: Authorizing `identity:get_user(user_id=be6d499cdc124bb9beef73ce61851609)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:49.823372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:49.824953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 605/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Sep 15 12:47:49 2022] GET /identity/v3/users/be6d499cdc124bb9beef73ce61851609 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:49.831030 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:49.876275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:49.938292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfa1e0-9ab9-4bde-b512-8d024e1cb6a8 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:49.974157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:49.974959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:49.975347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:49.975609 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:50.042569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:50.044021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:50.085335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:50.144233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 593/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:47:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:47:50.150813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:50.253920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:47:50.260896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f105-d72e-4429-9b84-6ea425eec6ce None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:50.296274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869ad8-850b-4896-8eb1-f5b762952d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:50.296903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869ad8-850b-4896-8eb1-f5b762952d0f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:50.297173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869ad8-850b-4896-8eb1-f5b762952d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:50.297440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869ad8-850b-4896-8eb1-f5b762952d0f None admin] PATH_INFO: `/v3/projects/93441d241b784cb0a841952cb628cbf0` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:50.298554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88869ad8-850b-4896-8eb1-f5b762952d0f None admin] RBAC: Authorizing `identity:get_project(project_id=93441d241b784cb0a841952cb628cbf0)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:50.300024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88869ad8-850b-4896-8eb1-f5b762952d0f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:50.301648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 606/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Sep 15 12:47:50 2022] GET /identity/v3/projects/93441d241b784cb0a841952cb628cbf0 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:47:50.308078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:47:50.409041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e78e64-fb13-4237-a970-8ca40a69d0f4 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:47:50.449495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc73094-7b5c-409f-b881-ad3dceb2185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:47:50.450115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73094-7b5c-409f-b881-ad3dceb2185c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:47:50.450390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73094-7b5c-409f-b881-ad3dceb2185c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:47:50.450651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc73094-7b5c-409f-b881-ad3dceb2185c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:47:50.451373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc73094-7b5c-409f-b881-ad3dceb2185c None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=93441d241b784cb0a841952cb628cbf0, user.id=be6d499cdc124bb9beef73ce61851609) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:47:50.451671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc73094-7b5c-409f-b881-ad3dceb2185c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:47:50.453136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc73094-7b5c-409f-b881-ad3dceb2185c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:47:50.460438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 594/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:47:50 2022] GET /identity/v3/role_assignments?user.id=be6d499cdc124bb9beef73ce61851609&scope.project.id=93441d241b784cb0a841952cb628cbf0&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:00.291141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=18 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:00.456817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=98 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:46.806573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239500-cd52-4e6c-a257-15e727ceb174 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:46.807186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239500-cd52-4e6c-a257-15e727ceb174 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:46.807186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239500-cd52-4e6c-a257-15e727ceb174 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:46.809041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 607/1201] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:48:46.815530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7371fb-f620-43cd-bc8b-d2e7782f85da None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:46.816019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7371fb-f620-43cd-bc8b-d2e7782f85da None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:46.816215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7371fb-f620-43cd-bc8b-d2e7782f85da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:46.838676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9c7371fb-f620-43cd-bc8b-d2e7782f85da None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:48:46.840087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9c7371fb-f620-43cd-bc8b-d2e7782f85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:48:46.921043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 595/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:48:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:48:47.232401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239500-cd52-4e6c-a257-15e727ceb174 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:47.363662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239500-cd52-4e6c-a257-15e727ceb174 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:47.404020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:47.404756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:47.405069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:47.405406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:47.418125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:47.419683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:48:47.440690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:47.442182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:48:47.444255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:48:47.444255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:47.444255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:48:47.446419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 608/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:47.452360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7371fb-f620-43cd-bc8b-d2e7782f85da None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:47.574312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7371fb-f620-43cd-bc8b-d2e7782f85da None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:47.613145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:47.623423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa3885-5dd9-4fff-b599-d28e4b54b1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:47.624329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa3885-5dd9-4fff-b599-d28e4b54b1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:47.624895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa3885-5dd9-4fff-b599-d28e4b54b1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:47.625224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa3885-5dd9-4fff-b599-d28e4b54b1c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:47.625898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa3885-5dd9-4fff-b599-d28e4b54b1c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:47.626207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa3885-5dd9-4fff-b599-d28e4b54b1c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:47.628092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa3885-5dd9-4fff-b599-d28e4b54b1c5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:47.643847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 596/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:47.647691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:47.720673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:47.782288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f7c61-90cf-42b3-9786-3b162be1926d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:47.832115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38216e5a-15be-4e99-b344-1d9efbbf8df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:47.832785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38216e5a-15be-4e99-b344-1d9efbbf8df0 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:47.833062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38216e5a-15be-4e99-b344-1d9efbbf8df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:47.833329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38216e5a-15be-4e99-b344-1d9efbbf8df0 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:47.833978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38216e5a-15be-4e99-b344-1d9efbbf8df0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:47.835425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38216e5a-15be-4e99-b344-1d9efbbf8df0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:47.865312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 609/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Sep 15 12:48:47 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:48:50.242378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a7ef-0b45-4828-98eb-5e99998768b0 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:50.242974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a7ef-0b45-4828-98eb-5e99998768b0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:50.242974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967a7ef-0b45-4828-98eb-5e99998768b0 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:50.244320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 597/1206] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:48:50.249824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd90a-57a5-4804-8436-58544c7cafac None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:50.250258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd90a-57a5-4804-8436-58544c7cafac None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:50.250343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd90a-57a5-4804-8436-58544c7cafac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:50.270483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2f4dd90a-57a5-4804-8436-58544c7cafac None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:48:50.272748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2f4dd90a-57a5-4804-8436-58544c7cafac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:48:50.352668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 610/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:48:50.621154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a7ef-0b45-4828-98eb-5e99998768b0 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:50.734164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967a7ef-0b45-4828-98eb-5e99998768b0 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:50.772878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:50.773594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:50.773893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:50.774157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:50.789447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:48:50.794818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:50.797547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:50.798481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 598/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:48:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:50.803661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dd90a-57a5-4804-8436-58544c7cafac None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:50.853823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:50.928787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dd90a-57a5-4804-8436-58544c7cafac None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:50.969007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:50.969590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:50.969925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:50.970730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:50.971490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:50.971805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:50.973190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:50.988584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 611/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:48:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:50.988972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:51.052500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:51.114482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c5d8-805e-468c-82dd-9fe8c5c2da0e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:51.164331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:51.166489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:51.166489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:51.166489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:51.180252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:51.181772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:48:51.197684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:51.206002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:48:51.207142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:48:51.207142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:51.207142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:51.207142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 599/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:48:51.207442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:51.322793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:51.329075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a09a6-30ef-4532-a135-1de1e0644c7b None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:51.368882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:51.369647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:51.370013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:51.370392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:51.371121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:51.371554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:51.373570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:51.388184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 612/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:51.394552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:51.503763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c82f81-304b-41a0-8d56-8a1680665c6b None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:51.505652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:51.541791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:51.542533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:51.542872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:51.543201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:51.551203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:51.552637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:48:51.565953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:51.567158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:48:51.568567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:51.570381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 600/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:48:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:51.576424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:51.692055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c2a2d-b235-4ca4-b30c-cce48516f169 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:51.732024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:51.732643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:51.732906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:51.733187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:51.734069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:51.734372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:51.735842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:51.761985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 613/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Sep 15 12:48:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:48:51.763616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:51.882850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece0def-3fa6-4447-8dd4-d9ff3bced917 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:51.921179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:51.922175 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:51.922697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:51.923272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:51.965330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:52.010798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:52.012335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:52.141606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 601/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:48:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:48:52.148227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:52.168208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:52.257014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10f235-98a0-4105-a9bb-1cb899725a09 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:52.294018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:52.294661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:52.294935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:52.295198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:52.306495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:52.308002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:48:52.323674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:52.325504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:48:52.326714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:48:52.326714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:52.326714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:48:52.326714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 614/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:48:52.330933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:52.395511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:52.436733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba49c71-d34f-4d0a-92a4-7ab10e49ce44 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:52.474599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:52.475225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:52.475500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:52.476133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:52.476777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:52.477076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:52.478447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:52.490417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 602/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:52.496450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:52.572157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:52.605340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4ee00-9f10-4e9d-8d65-1ddead30e6e0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:52.640402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:52.641016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:52.641362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:52.641558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:52.648822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:52.650304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:48:52.662879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:52.664106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:48:52.664998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 615/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:48:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:52.669952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:52.774387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57375c-48b0-40cf-9d41-24b02df1fb78 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:52.797744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:52.810831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5122445-997e-49dc-b445-1173015907c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:52.811479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122445-997e-49dc-b445-1173015907c9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:52.811788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122445-997e-49dc-b445-1173015907c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:52.812051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5122445-997e-49dc-b445-1173015907c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:52.813625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5122445-997e-49dc-b445-1173015907c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:52.814195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5122445-997e-49dc-b445-1173015907c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:52.815622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5122445-997e-49dc-b445-1173015907c9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:52.828357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 603/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:48:52.834828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:52.945244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7dc20-b08d-4e36-8fb4-ff1ef440890d None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:52.976233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:52.985913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb6f6-8867-4545-8e97-8d4c89becc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:52.986551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb6f6-8867-4545-8e97-8d4c89becc8c None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:52.986824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb6f6-8867-4545-8e97-8d4c89becc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:52.987087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb6f6-8867-4545-8e97-8d4c89becc8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:52.987835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb6f6-8867-4545-8e97-8d4c89becc8c None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=5d89f4bf4bcb4b408a693a68edf87878) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:52.988138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb6f6-8867-4545-8e97-8d4c89becc8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:52.989564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb6f6-8867-4545-8e97-8d4c89becc8c None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:52.996231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 616/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:48:52 2022] GET /identity/v3/role_assignments?user.id=5d89f4bf4bcb4b408a693a68edf87878&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:55.250923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506b508-ed69-4a4c-ade5-f220de86dfb5 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:55.251774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506b508-ed69-4a4c-ade5-f220de86dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:55.252054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506b508-ed69-4a4c-ade5-f220de86dfb5 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:55.253610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 604/1220] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:48:55.259068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea8ae2-3533-4bc7-96a4-5984c518195c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:55.259471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea8ae2-3533-4bc7-96a4-5984c518195c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:55.259598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea8ae2-3533-4bc7-96a4-5984c518195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:55.278806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-cdea8ae2-3533-4bc7-96a4-5984c518195c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:48:55.280134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-cdea8ae2-3533-4bc7-96a4-5984c518195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:48:55.352333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 617/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:48:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:48:55.623902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506b508-ed69-4a4c-ade5-f220de86dfb5 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:55.733278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506b508-ed69-4a4c-ade5-f220de86dfb5 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:55.769519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:55.770228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:55.770537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:55.770831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:55.781104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:48:55.786614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:55.787771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:55.789095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 605/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:48:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:55.794001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea8ae2-3533-4bc7-96a4-5984c518195c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:55.897359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea8ae2-3533-4bc7-96a4-5984c518195c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:55.922819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:55.936956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:55.937950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:55.938275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:55.938657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:55.939314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] RBAC: Adding query filter params (name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:55.939609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:55.941012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:55.953693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 618/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:48:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:55.955808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:56.008499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:56.071818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19df7fc-7daf-4107-af18-c4a55b87c36d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:56.116732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:56.117499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:56.117970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:56.118365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:56.133126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:56.134736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:48:56.153586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:56.154768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:48:56.155664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:48:56.155664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:56.155664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:56.155664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 606/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:56.161515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:56.273942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686deb-003a-4bd1-8bd7-f6ddf5c6a3df None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:56.311356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:56.312125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:56.312401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:56.312714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:56.313545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:56.313893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:56.315297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:56.328604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 619/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:56.334871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:56.434395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:56.443464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f98ba3-96a5-4f10-98d3-0c0481129b57 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:56.482397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:56.483089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:56.483438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:56.483837 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:56.493117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:56.494545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:48:56.508419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:56.509598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:56.510588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 607/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:48:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:48:56.518573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:56.575354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:56.645942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470959-43ad-485b-8a6e-45a9f1d59f15 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:56.685306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:56.685914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:56.686212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:56.686533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:56.687391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:56.687724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:56.689213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:56.712737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 620/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Sep 15 12:48:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:48:56.714068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:56.824841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0849c-9eee-4d67-88fa-92463022b5ba None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:56.859571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:56.860283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:56.860554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:56.860814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:56.871171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:56.872623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:48:56.887479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:56.888611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:48:56.889848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:48:56.889848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:48:56.889848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:56.889848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 608/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:56.895046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:57.040895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffe91f-9a2d-44a4-b12c-b77f7396264f None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:57.043293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:57.078250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:57.078968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:57.079305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:57.079510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:57.080246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:57.080544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:57.082004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:57.094783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 621/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:48:57.101287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:57.111802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:57.214729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8ff9-156f-4b31-8113-eee39ec12c36 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:57.248918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:57.249569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:57.249828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:57.250099 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:57.257263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:57.258782 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:48:57.270844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:48:57.272033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:48:57.273106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 609/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:48:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:48:57.278767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:57.390118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7c1d1-fdf9-4d12-8f02-8ed25c7696c5 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:57.428581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059999e-f592-47b8-9d12-3596045e7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:57.429175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059999e-f592-47b8-9d12-3596045e7dbd None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:57.429437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059999e-f592-47b8-9d12-3596045e7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:57.429699 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059999e-f592-47b8-9d12-3596045e7dbd None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:57.430382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059999e-f592-47b8-9d12-3596045e7dbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:48:57.430705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059999e-f592-47b8-9d12-3596045e7dbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:57.432879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059999e-f592-47b8-9d12-3596045e7dbd None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:57.445603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 622/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:48:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:48:57.451835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:48:57.522735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:48:57.564040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b48ef3-211b-456a-9c1c-408a8a567c09 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:48:57.600093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474b2ab-101b-4e92-8d55-82937975c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:48:57.601158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b2ab-101b-4e92-8d55-82937975c47b None admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:57.601508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b2ab-101b-4e92-8d55-82937975c47b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:57.601866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b2ab-101b-4e92-8d55-82937975c47b None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/5d89f4bf4bcb4b408a693a68edf87878/roles/18adaf361b7749e69eabe75f61459b46` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:57.618687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474b2ab-101b-4e92-8d55-82937975c47b None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=5d89f4bf4bcb4b408a693a68edf87878, role_id=18adaf361b7749e69eabe75f61459b46)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:48:57.620344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474b2ab-101b-4e92-8d55-82937975c47b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:48:57.634695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 610/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:48:57 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/5d89f4bf4bcb4b408a693a68edf87878/roles/18adaf361b7749e69eabe75f61459b46 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:48:59.743077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4492-e243-4e84-9779-dda573bc8ff0 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:59.743660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4492-e243-4e84-9779-dda573bc8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:59.743660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4492-e243-4e84-9779-dda573bc8ff0 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:59.744924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 623/1233] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:48:59.750474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9fe5-5fa0-41d6-abcb-bdf98b44780d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:48:59.750963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9fe5-5fa0-41d6-abcb-bdf98b44780d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:48:59.751067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9fe5-5fa0-41d6-abcb-bdf98b44780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:48:59.770067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-501d9fe5-5fa0-41d6-abcb-bdf98b44780d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:48:59.771272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-501d9fe5-5fa0-41d6-abcb-bdf98b44780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:48:59.843523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 611/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:48:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:49:00.106240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f4492-e243-4e84-9779-dda573bc8ff0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:00.133948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:00.214938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f4492-e243-4e84-9779-dda573bc8ff0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:00.253205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:00.253843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:00.254153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:00.254483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:00.266682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:49:00.271663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:00.275829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:00.276934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 624/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Sep 15 12:49:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:00.279257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9fe5-5fa0-41d6-abcb-bdf98b44780d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:00.327194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:00.384958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9fe5-5fa0-41d6-abcb-bdf98b44780d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:00.421803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:00.422577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:00.422852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:00.423129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:00.423963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] RBAC: Adding query filter params (name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:00.424296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:00.425910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:00.434508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 612/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Sep 15 12:49:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:00.441470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:00.532610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:00.548792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0fae4-abf1-4103-b70e-cfb8a1c9818a None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:00.583362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:00.584018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:00.584293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:00.584553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:00.594637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:00.596136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:00.612346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:00.613645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:00.614812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:00.614812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:00.614812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:00.614812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 625/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:00.619843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:00.725954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae31bbf-8459-4bea-a8b8-67eb67f7d358 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:00.735626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:00.762651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:00.763323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:00.763587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:00.763810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:00.764435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:00.764735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:00.766129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:00.778174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 613/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:00.784389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:00.895819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780c70-a4c6-4c72-8f7a-a42fa679cc17 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:00.932017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:00.932653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:00.932927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:00.933187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:00.936005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:00.943254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:00.944049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:49:00.956970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:00.957980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:00.959007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 626/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:00.964279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:01.077030 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45e9da-fd42-4467-9fb1-ec89aabd56d7 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:01.117118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:01.117742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:01.118018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:01.118331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:01.119165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:01.119501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:01.121019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:01.144386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 614/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Sep 15 12:49:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:01.150496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:01.269503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1be607-46d3-4778-8c37-72b221e8afc9 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:01.310164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:01.310809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:01.311078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:01.311340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:01.375270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:01.382977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:01.384461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:01.495339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 627/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:49:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:49:01.501828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:01.532427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:01.611815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334612fe-c8db-4ceb-a0ba-d033721bb506 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:01.650254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:01.650875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:01.651158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:01.651518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:01.662232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:01.663799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:01.680144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:01.686276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:01.687387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:01.687387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:01.687387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:01.687387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 615/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:49:01.687639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:01.789623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:01.796480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989d6b7-b70d-4a20-b6d8-af48a90dd98e None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:01.833543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:01.834274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:01.834552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:01.834893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:01.835657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:01.836043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:01.837422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:01.850973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 628/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:01.857863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:01.941795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:01.966220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b938a7-e4a4-471b-9823-2c879af5296f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:02.004507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:02.005148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:02.005425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:02.005706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:02.012747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:02.014397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:49:02.025850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:02.027150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:02.028435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 616/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:49:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:49:02.035049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:02.151386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7ad78-a985-478b-a4e8-2e0dad2ceab8 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:02.189912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e4e81-c3a9-406f-a0eb-f7870c7935bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:02.190626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e4e81-c3a9-406f-a0eb-f7870c7935bf None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:02.190905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e4e81-c3a9-406f-a0eb-f7870c7935bf None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:02.191204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e4e81-c3a9-406f-a0eb-f7870c7935bf None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:02.192004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e4e81-c3a9-406f-a0eb-f7870c7935bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:02.192259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e4e81-c3a9-406f-a0eb-f7870c7935bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:02.193702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e4e81-c3a9-406f-a0eb-f7870c7935bf None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:02.205986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 629/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:49:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:02.212769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:02.326634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74861c62-1bc4-4ec9-a776-a25b42980307 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:02.362234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf4aea-6473-49f7-959d-5938d6e29cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:02.362879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4aea-6473-49f7-959d-5938d6e29cdb None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:02.363154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4aea-6473-49f7-959d-5938d6e29cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:02.363419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4aea-6473-49f7-959d-5938d6e29cdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:02.364254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf4aea-6473-49f7-959d-5938d6e29cdb None admin] RBAC: Adding query filter params (role.id=18adaf361b7749e69eabe75f61459b46, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=5d89f4bf4bcb4b408a693a68edf87878) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:02.364571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf4aea-6473-49f7-959d-5938d6e29cdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:02.366041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf4aea-6473-49f7-959d-5938d6e29cdb None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:02.372257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 617/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:49:02 2022] GET /identity/v3/role_assignments?user.id=5d89f4bf4bcb4b408a693a68edf87878&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=18adaf361b7749e69eabe75f61459b46 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:49:04.634089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002d68-14bd-4753-a1f5-2970cd623092 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:04.634089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002d68-14bd-4753-a1f5-2970cd623092 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:04.634089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96002d68-14bd-4753-a1f5-2970cd623092 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:04.634089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 630/1247] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:49:04.641407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743acbd-ddd4-4a8e-8229-7630af7ace45 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:04.641909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743acbd-ddd4-4a8e-8229-7630af7ace45 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:04.642084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743acbd-ddd4-4a8e-8229-7630af7ace45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:04.650323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:04.663971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9743acbd-ddd4-4a8e-8229-7630af7ace45 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:49:04.665195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9743acbd-ddd4-4a8e-8229-7630af7ace45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:49:04.743891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 618/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:49:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:49:05.005942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002d68-14bd-4753-a1f5-2970cd623092 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:05.029024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:05.134741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96002d68-14bd-4753-a1f5-2970cd623092 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:05.171029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:05.171681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:05.172076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:05.172342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:05.183611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:49:05.189050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:05.190233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:05.191444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 631/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:49:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:05.196538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743acbd-ddd4-4a8e-8229-7630af7ace45 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:05.304804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743acbd-ddd4-4a8e-8229-7630af7ace45 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:05.352226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:05.358681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:05.359455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:05.359874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:05.360551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:05.361668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:05.362131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:05.364033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:05.373985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 619/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:49:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:05.380613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:05.470389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:05.493112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a6d2b-6947-46a4-961d-5cb6ae7a9bb0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:05.526301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:05.526986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:05.527224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:05.527520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:05.538150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:05.539817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:05.555110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:05.556358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:05.557464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:05.557464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:05.557464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:05.557464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 632/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:49:05.562655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:05.680060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1955d3-64da-4ac5-a1a2-51758dbdafbf None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:05.717772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:05.718068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:05.718337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:05.718639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:05.719565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:05.719904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:05.721266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:05.733639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 620/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:05.740104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:05.856551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f1bcb-675f-4492-87ef-162bad7ed3d0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:05.885431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:05.894732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:05.895381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:05.895659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:05.895953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:05.903577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:05.905051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:49:05.916641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:05.923546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:05.924744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 633/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:05.925556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:05.988850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:06.042706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbb7c2-dc05-4862-97eb-3a5e8ebbe253 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:06.078321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:06.078932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:06.079209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:06.079472 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:06.080259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:06.080559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:06.081976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:06.099374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 621/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Sep 15 12:49:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:06.105969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:06.224523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab2562-9127-4eab-8a11-1de61790f0ec None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:06.273973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:06.274594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:06.274865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:06.275131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:06.342038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:06.361968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:06.363430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:06.496386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 634/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:49:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:49:06.502668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:06.616138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efd37b-eaac-4864-8cef-c5557c2fd952 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:06.631177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:06.664495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:06.665485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:06.665864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:06.666129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:06.677729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:06.679500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:06.695734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:06.697423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:06.698525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:06.698525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:06.698525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:06.698525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 622/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:06.703736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:06.812952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:06.826579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc8e2c-36ef-401c-bd84-546953d3e699 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:06.871792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:06.872584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:06.873027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:06.873571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:06.874741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:06.875397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:06.877907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:06.891616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 635/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:06.897846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:07.023633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8eb86-3b67-4103-a652-8bb37396e90c None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:07.074325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:07.076362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:07.076362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:07.076362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:07.085475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:07.087783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:49:07.106825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:07.107830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:07.109016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 623/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:49:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:07.114617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:07.244488 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba0f1a-1b1f-41f1-8fec-5c4537b7deeb None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:07.284860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfcc1e-7a23-479f-96bf-cd4ec6f170f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:07.285495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfcc1e-7a23-479f-96bf-cd4ec6f170f0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:07.285772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfcc1e-7a23-479f-96bf-cd4ec6f170f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:07.286040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfcc1e-7a23-479f-96bf-cd4ec6f170f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:07.286745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfcc1e-7a23-479f-96bf-cd4ec6f170f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:07.287047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfcc1e-7a23-479f-96bf-cd4ec6f170f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:07.288567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfcc1e-7a23-479f-96bf-cd4ec6f170f0 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:07.303075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 636/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:49:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:07.309677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:07.338947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:07.423516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df611a-f4cf-42ab-99e9-911d77df3eae None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:07.470172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0f847-7582-4a52-bfb0-fe954c5c829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:07.470800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f847-7582-4a52-bfb0-fe954c5c829d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:07.471073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f847-7582-4a52-bfb0-fe954c5c829d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:07.471326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0f847-7582-4a52-bfb0-fe954c5c829d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:07.472082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0f847-7582-4a52-bfb0-fe954c5c829d None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=5d89f4bf4bcb4b408a693a68edf87878) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:07.472391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0f847-7582-4a52-bfb0-fe954c5c829d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:07.473870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0f847-7582-4a52-bfb0-fe954c5c829d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:07.480555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 624/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:49:07 2022] GET /identity/v3/role_assignments?user.id=5d89f4bf4bcb4b408a693a68edf87878&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:09.589484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939ed-27b6-4d6d-ac4f-241dfdb7e100 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:09.590386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939ed-27b6-4d6d-ac4f-241dfdb7e100 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:09.590386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329939ed-27b6-4d6d-ac4f-241dfdb7e100 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:09.592610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 637/1261] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:49:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:49:09.598897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e4b1-845a-42d0-afda-9cd5a54cfb50 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:09.599335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e4b1-845a-42d0-afda-9cd5a54cfb50 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:09.599428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46e4b1-845a-42d0-afda-9cd5a54cfb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:09.628065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9b46e4b1-845a-42d0-afda-9cd5a54cfb50 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:49:09.629274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9b46e4b1-845a-42d0-afda-9cd5a54cfb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:49:09.703936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 625/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:49:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:49:09.969743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329939ed-27b6-4d6d-ac4f-241dfdb7e100 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:09.987077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:10.093489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329939ed-27b6-4d6d-ac4f-241dfdb7e100 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:10.135495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:10.136392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:10.136693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:10.137073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:10.149752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:49:10.155250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:10.156964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:10.158469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 638/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:49:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:10.162992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e4b1-845a-42d0-afda-9cd5a54cfb50 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:10.183096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:10.267322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46e4b1-845a-42d0-afda-9cd5a54cfb50 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:10.301597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:10.302187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:10.302418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:10.302708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:10.303613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:10.303938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:10.305287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:10.313457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 626/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:49:10.319518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:10.390591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:10.434196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc946e27-c376-406e-a8b0-05a964e7c5c0 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:10.470142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:10.470765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:10.471120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:10.471398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:10.481833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:10.483292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:10.497916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:10.498973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:10.500803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:10.500803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:10.500803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:10.500803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 639/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:10.505165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:10.591935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:10.612045 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0c06-140d-4688-822b-a31e8772a35f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:10.645799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:10.646386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:10.646642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:10.646907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:10.647526 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:10.647852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:10.649207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:10.660542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 627/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:10.667018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:10.773273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6631-3484-45cd-9c8f-0cf8bc9c56d4 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:10.793317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:10.808995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:10.809607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:10.809872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:10.810132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:10.819154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:10.820615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:49:10.831798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:10.832873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:10.833937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 640/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:10.839614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:10.955520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8666fd4-8a0b-4eec-9b96-054c41ba0953 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:10.990293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:10.990886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:10.991160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:10.991422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:10.992160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:10.992457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:10.993883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:11.002811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:11.019132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 628/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Sep 15 12:49:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:11.025264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:11.133670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4480b0-73fc-4717-a4b8-6164195742ea None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:11.168522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:11.169143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:11.169418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:11.169680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:11.180943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:11.182386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:11.196966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:11.198036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:11.199349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:11.199349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:11.199349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:11.199349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 641/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:11.207233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:11.329703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6473b2-47f8-47cb-8685-9ece9bc232b5 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:11.366595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:11.367188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:11.367462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:11.367741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:11.368369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:11.368665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:11.370015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:11.382718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 629/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:11.389313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:11.422411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:11.495896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02a72-b434-4b57-868c-250b6fff87bc None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:11.530225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:11.530912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:11.531293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:11.531424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:11.538251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:11.539725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:49:11.551277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:11.552326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:11.553294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 642/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:49:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:11.561048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:11.627398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:11.672908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818228-a770-40a6-a4c1-c684d4adf979 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:11.707976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c28788-ca47-44a9-9d33-2219681c393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:11.708566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c28788-ca47-44a9-9d33-2219681c393b None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:11.708812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c28788-ca47-44a9-9d33-2219681c393b None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:11.709085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c28788-ca47-44a9-9d33-2219681c393b None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:11.709754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c28788-ca47-44a9-9d33-2219681c393b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:11.710051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c28788-ca47-44a9-9d33-2219681c393b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:11.711454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c28788-ca47-44a9-9d33-2219681c393b None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:11.723199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 630/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:49:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:11.730041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:11.835689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:11.846173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dec81b-9996-4794-b837-2ae4d4a65440 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:11.885798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d80a2e-56c9-4722-a75b-dfd3a5c7d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:11.886443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d80a2e-56c9-4722-a75b-dfd3a5c7d6c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:11.886707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d80a2e-56c9-4722-a75b-dfd3a5c7d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:11.886968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d80a2e-56c9-4722-a75b-dfd3a5c7d6c6 None admin] PATH_INFO: `/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/5d89f4bf4bcb4b408a693a68edf87878/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:11.889070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d80a2e-56c9-4722-a75b-dfd3a5c7d6c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297a1da4cf24be59d9195e935f4136f, user_id=5d89f4bf4bcb4b408a693a68edf87878, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:11.890622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d80a2e-56c9-4722-a75b-dfd3a5c7d6c6 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:11.911368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 643/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Sep 15 12:49:11 2022] PUT /identity/v3/projects/7297a1da4cf24be59d9195e935f4136f/users/5d89f4bf4bcb4b408a693a68edf87878/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:49:14.006727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646edcf3-b34f-4da7-99f4-aa5ec9b70b0d None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:14.007572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646edcf3-b34f-4da7-99f4-aa5ec9b70b0d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:14.007572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646edcf3-b34f-4da7-99f4-aa5ec9b70b0d None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:14.009784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 631/1274] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:49:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:49:14.018358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db1fa-67d9-45d5-b31e-9b66b2100ef8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:14.018815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db1fa-67d9-45d5-b31e-9b66b2100ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:14.018920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db1fa-67d9-45d5-b31e-9b66b2100ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:14.038957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7b3db1fa-67d9-45d5-b31e-9b66b2100ef8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:49:14.040287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7b3db1fa-67d9-45d5-b31e-9b66b2100ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:49:14.111513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 644/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:49:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:49:14.392475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646edcf3-b34f-4da7-99f4-aa5ec9b70b0d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:14.511432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646edcf3-b34f-4da7-99f4-aa5ec9b70b0d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:14.528914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:14.547494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:14.548226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:14.548501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:14.548767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:14.559388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:49:14.564239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:14.565332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:14.566342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 632/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Sep 15 12:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:14.571525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3db1fa-67d9-45d5-b31e-9b66b2100ef8 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:14.654541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:14.674376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3db1fa-67d9-45d5-b31e-9b66b2100ef8 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:14.713298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:14.713901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:14.714174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:14.714441 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:14.715099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:14.715397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:14.716820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:14.725247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 645/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Sep 15 12:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:14.732051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:14.836056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32b33-25af-453a-818e-49d069a82122 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:14.876267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:14.876878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:14.877151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:14.877447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:14.887881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:14.889319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:14.904387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:14.905621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:14.906516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:14.906516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:14.906516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:14.906516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 633/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:14.912068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:15.020770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573eb83-96bd-45a4-b751-3a3ef4d3eeaf None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:15.056256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:15.056850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:15.057120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:15.057382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:15.058014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:15.058302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:15.059680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:15.071544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 646/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:15.078389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:15.120124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:15.193949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90e81-4363-4259-bc37-1fc0b64d55e9 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:15.229758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:15.230375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:15.230647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:15.230915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:15.238697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:15.240171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:49:15.251542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:15.252675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:15.253618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 634/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:15.260558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:15.264835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:15.364393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69f168-94c8-4aa6-a715-2cb0e5b52616 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:15.400867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:15.401459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:15.401726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:15.401987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:15.402697 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:15.402991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:15.404440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:15.422347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 647/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Sep 15 12:49:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:15.428326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:15.527170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:15.538880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87dc99a-72eb-4418-9e2e-900e31b21e8f None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:15.575428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:15.576054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:15.576331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:15.576593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:15.651409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:15.653647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:15.747349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:15.763610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 635/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Sep 15 12:49:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:49:15.773153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:15.845664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:15.886505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553fa9-9ce2-4f62-a676-06e8acaa9b75 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:15.923436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:15.924078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:15.924344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:15.924605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:15.934782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:15.936258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:49:15.951738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:15.953287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:49:15.954290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:49:15.954290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:49:15.954290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:15.954290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 648/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:15.958947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:16.063538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36fea9-2a73-47e1-9036-d098ac362b04 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:16.102190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:16.102885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:16.103068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:16.103333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:16.104014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:16.104310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:16.105665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:16.117505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 636/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Sep 15 12:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:16.123424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:16.235239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23b879-a60f-4ef2-84a4-8f9a345e5c38 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:16.250215 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:16.280609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:16.281326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:16.281599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:16.281859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:16.288390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:16.289830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:49:16.302144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:16.303124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: ERROR keystone.server.flask.application Sep 15 12:49:16.304118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 649/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Sep 15 12:49:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:16.309607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:16.361967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:16.418566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abc5f8-6ab6-4b93-8bfc-eb3125933667 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:16.455455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56b61d-4e06-44b0-9a1f-1fcea0b5d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:16.456097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b61d-4e06-44b0-9a1f-1fcea0b5d3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:16.456369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b61d-4e06-44b0-9a1f-1fcea0b5d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:16.456631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b61d-4e06-44b0-9a1f-1fcea0b5d3f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:16.457309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56b61d-4e06-44b0-9a1f-1fcea0b5d3f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:16.457601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56b61d-4e06-44b0-9a1f-1fcea0b5d3f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:16.459109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56b61d-4e06-44b0-9a1f-1fcea0b5d3f8 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:16.471291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 637/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Sep 15 12:49:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:16.478028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:16.591266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90237c-10e2-48ed-b1ae-03e6af2b7477 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:16.634948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a8326-455e-44aa-a591-955c118bf815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:16.635470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8326-455e-44aa-a591-955c118bf815 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:16.635745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8326-455e-44aa-a591-955c118bf815 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:16.636024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8326-455e-44aa-a591-955c118bf815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:16.636749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8326-455e-44aa-a591-955c118bf815 None admin] RBAC: Adding query filter params (role.id=acf6726bf46b432c9dbb6d1f5610893f, scope.project.id=7297a1da4cf24be59d9195e935f4136f, user.id=5d89f4bf4bcb4b408a693a68edf87878) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:16.637047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8326-455e-44aa-a591-955c118bf815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:16.638490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8326-455e-44aa-a591-955c118bf815 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:16.644787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 650/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Sep 15 12:49:16 2022] GET /identity/v3/role_assignments?user.id=5d89f4bf4bcb4b408a693a68edf87878&scope.project.id=7297a1da4cf24be59d9195e935f4136f&role.id=acf6726bf46b432c9dbb6d1f5610893f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:18.784220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb1e1f-4dc8-4cf5-9aaa-e4d5baefc299 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:18.784767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb1e1f-4dc8-4cf5-9aaa-e4d5baefc299 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:18.784767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb1e1f-4dc8-4cf5-9aaa-e4d5baefc299 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:18.786011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 638/1288] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:49:18.792709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eab67-9fd8-4494-9e0e-21e06e456650 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:18.793135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eab67-9fd8-4494-9e0e-21e06e456650 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:18.793245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eab67-9fd8-4494-9e0e-21e06e456650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:18.818908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8a7eab67-9fd8-4494-9e0e-21e06e456650 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:49:18.820119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8a7eab67-9fd8-4494-9e0e-21e06e456650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:49:18.851589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:18.893279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 651/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:49:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:49:19.157918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb1e1f-4dc8-4cf5-9aaa-e4d5baefc299 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:19.266546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb1e1f-4dc8-4cf5-9aaa-e4d5baefc299 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:19.281160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:19.306824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:19.307451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:19.307783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:19.308042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:19.308617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:19.310006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:19.319998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:19.323950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:19.325040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 639/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:49:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:19.327635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eab67-9fd8-4494-9e0e-21e06e456650 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:19.429455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eab67-9fd8-4494-9e0e-21e06e456650 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:19.464001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52695d3c-c40d-41c4-888d-266559486125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:19.464597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695d3c-c40d-41c4-888d-266559486125 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:19.464867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695d3c-c40d-41c4-888d-266559486125 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:19.465127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695d3c-c40d-41c4-888d-266559486125 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:19.465743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52695d3c-c40d-41c4-888d-266559486125 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:19.466030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52695d3c-c40d-41c4-888d-266559486125 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:19.467403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52695d3c-c40d-41c4-888d-266559486125 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:19.472228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 652/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Sep 15 12:49:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:19.478512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:19.594798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c476286-a8fa-4f12-b5e6-09b6786bc76e None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:19.629929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f96e14-281d-47fb-8722-789914a5a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:19.630530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96e14-281d-47fb-8722-789914a5a633 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:19.630804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96e14-281d-47fb-8722-789914a5a633 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:19.631069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f96e14-281d-47fb-8722-789914a5a633 None admin] PATH_INFO: `/v3/services` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:19.631689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f96e14-281d-47fb-8722-789914a5a633 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:19.632023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f96e14-281d-47fb-8722-789914a5a633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:19.633397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f96e14-281d-47fb-8722-789914a5a633 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:19.637934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 640/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Sep 15 12:49:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:21.810681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755b17-9819-4108-8647-413bc7d42154 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:21.811546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755b17-9819-4108-8647-413bc7d42154 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:21.811546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67755b17-9819-4108-8647-413bc7d42154 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:21.813494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 653/1293] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:49:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:49:21.822839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7a04-af0e-4475-b6cd-e8ebbc4c6707 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:21.823360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7a04-af0e-4475-b6cd-e8ebbc4c6707 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:21.823457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7a04-af0e-4475-b6cd-e8ebbc4c6707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:21.849730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ee3b7a04-af0e-4475-b6cd-e8ebbc4c6707 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:49:21.850922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ee3b7a04-af0e-4475-b6cd-e8ebbc4c6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:49:21.883364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:21.925245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 641/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:49:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:49:22.201618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755b17-9819-4108-8647-413bc7d42154 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:22.238243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:22.311971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67755b17-9819-4108-8647-413bc7d42154 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:22.358186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745bcf4-10a2-4e2f-b137-fbc8f8920c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:22.358788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745bcf4-10a2-4e2f-b137-fbc8f8920c92 None admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:22.359058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745bcf4-10a2-4e2f-b137-fbc8f8920c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:22.359316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745bcf4-10a2-4e2f-b137-fbc8f8920c92 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:22.359991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745bcf4-10a2-4e2f-b137-fbc8f8920c92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:22.361361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745bcf4-10a2-4e2f-b137-fbc8f8920c92 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:22.382739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 654/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Sep 15 12:49:22 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:49:24.553664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329566-9fde-4903-9378-01e3108c4868 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:24.554246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329566-9fde-4903-9378-01e3108c4868 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:24.554246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329566-9fde-4903-9378-01e3108c4868 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:24.556323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 642/1296] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:49:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:49:24.564966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e48c8c-3d31-40f9-8135-ae8bc9f59700 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:24.565357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e48c8c-3d31-40f9-8135-ae8bc9f59700 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:24.565514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e48c8c-3d31-40f9-8135-ae8bc9f59700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:24.594278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-64e48c8c-3d31-40f9-8135-ae8bc9f59700 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:49:24.595493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-64e48c8c-3d31-40f9-8135-ae8bc9f59700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:49:24.686393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 655/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:49:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:49:24.949716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7329566-9fde-4903-9378-01e3108c4868 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:25.078312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7329566-9fde-4903-9378-01e3108c4868 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:25.122306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:25.122945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:25.123236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:25.123567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:25.124177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:25.125555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:25.134986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:25.139894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:25.140912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 643/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:49:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:25.142510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e48c8c-3d31-40f9-8135-ae8bc9f59700 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:25.162309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:25.251540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e48c8c-3d31-40f9-8135-ae8bc9f59700 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:25.287855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:25.288461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:25.288734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:25.289002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:25.289625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:25.289926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:25.291309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:25.298164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 656/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Sep 15 12:49:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:25.307537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:25.340948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:25.414450 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed788ae5-f0ee-406c-afe2-f440b0505b07 None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:25.452576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a15449-ef8f-41b3-89c1-54ffe64047f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:25.453189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a15449-ef8f-41b3-89c1-54ffe64047f1 None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:25.453465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a15449-ef8f-41b3-89c1-54ffe64047f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:25.453731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a15449-ef8f-41b3-89c1-54ffe64047f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:25.454421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a15449-ef8f-41b3-89c1-54ffe64047f1 None admin] RBAC: Adding query filter params (interface=public, service_id=c7b378f26726428cbdeb34e22e4abbb0, region_id=RegionOne) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:25.454725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a15449-ef8f-41b3-89c1-54ffe64047f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:25.456131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a15449-ef8f-41b3-89c1-54ffe64047f1 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:25.461873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 644/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Sep 15 12:49:25 2022] GET /identity/v3/endpoints?service_id=c7b378f26726428cbdeb34e22e4abbb0&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:49:25.469748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:25.560812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:25.592539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257571-22f5-470b-8a28-461f7c940851 None admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:25.635027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169d3a9-3e6e-4387-afc7-ef8ed98eaf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:25.636038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169d3a9-3e6e-4387-afc7-ef8ed98eaf43 None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:25.636503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169d3a9-3e6e-4387-afc7-ef8ed98eaf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:25.636944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169d3a9-3e6e-4387-afc7-ef8ed98eaf43 None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:25.637926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169d3a9-3e6e-4387-afc7-ef8ed98eaf43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:25.639994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169d3a9-3e6e-4387-afc7-ef8ed98eaf43 None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:25.647080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 657/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Sep 15 12:49:25 2022] GET /identity/v3/services => generated 2191 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:49:27.760715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152b2d-e134-4c3a-a7c0-a644ac415433 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:27.761528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152b2d-e134-4c3a-a7c0-a644ac415433 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:27.761528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc152b2d-e134-4c3a-a7c0-a644ac415433 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:27.763658 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 645/1302] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:49:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:49:27.772497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faabfe-40cf-4420-98c2-01365ee762e4 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:27.773174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faabfe-40cf-4420-98c2-01365ee762e4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:27.773387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faabfe-40cf-4420-98c2-01365ee762e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:27.795818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a8faabfe-40cf-4420-98c2-01365ee762e4 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:49:27.797044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a8faabfe-40cf-4420-98c2-01365ee762e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:49:27.870211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 658/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:49:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:49:28.143968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152b2d-e134-4c3a-a7c0-a644ac415433 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:28.257285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:28.269922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc152b2d-e134-4c3a-a7c0-a644ac415433 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:28.309556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:28.310182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:28.310543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:28.310992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:28.314444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:28.314444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:49:28.322449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:49:28.323914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application with Lock( Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: ERROR keystone.server.flask.application Sep 15 12:49:28.325126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 646/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Sep 15 12:49:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:49:28.329722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faabfe-40cf-4420-98c2-01365ee762e4 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:28.417955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:28.445866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faabfe-40cf-4420-98c2-01365ee762e4 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:28.484445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9539b7-8662-4d4d-beed-1aaaaf78d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:28.485045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9539b7-8662-4d4d-beed-1aaaaf78d6cc None admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:28.485313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9539b7-8662-4d4d-beed-1aaaaf78d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:28.485576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9539b7-8662-4d4d-beed-1aaaaf78d6cc None admin] PATH_INFO: `/v3/services` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:28.486198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9539b7-8662-4d4d-beed-1aaaaf78d6cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:49:28.486486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9539b7-8662-4d4d-beed-1aaaaf78d6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:28.487896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9539b7-8662-4d4d-beed-1aaaaf78d6cc None admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:28.493054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 659/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Sep 15 12:49:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:49:28.499722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:49:28.605623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2316590-767a-4f10-87fd-5629d8899b5d None admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:49:28.645724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598d7d7-7a55-443b-abf9-5ad80d6c3419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:49:28.646308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d7d7-7a55-443b-abf9-5ad80d6c3419 None admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:49:28.646578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d7d7-7a55-443b-abf9-5ad80d6c3419 None admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:49:28.646838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d7d7-7a55-443b-abf9-5ad80d6c3419 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:49:28.647486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598d7d7-7a55-443b-abf9-5ad80d6c3419 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:49:28.648865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598d7d7-7a55-443b-abf9-5ad80d6c3419 None admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:49:28.673174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 647/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:49:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:49:38.490368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=30 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:49:38.668646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:33.346902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774112cc-1d2c-493c-853f-237477663313 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:33.347387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774112cc-1d2c-493c-853f-237477663313 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:33.347599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774112cc-1d2c-493c-853f-237477663313 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:33.353171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 660/1307] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:33.354616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c24c-2968-44ed-a3cf-858a2d327cf6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:33.354616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c24c-2968-44ed-a3cf-858a2d327cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:33.354616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c24c-2968-44ed-a3cf-858a2d327cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:33.534147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-6d34c24c-2968-44ed-a3cf-858a2d327cf6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:33.535670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6d34c24c-2968-44ed-a3cf-858a2d327cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:33.671792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 648/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:50:33.963065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d312e4-d701-4f90-baee-530a7c6a29aa None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:33.963340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d312e4-d701-4f90-baee-530a7c6a29aa None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:33.963921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d312e4-d701-4f90-baee-530a7c6a29aa None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:33.965513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 661/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Sep 15 12:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:33.972128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd60e-6d85-4c58-a56f-71ccd88f3f62 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:33.972478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd60e-6d85-4c58-a56f-71ccd88f3f62 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:33.972811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd60e-6d85-4c58-a56f-71ccd88f3f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:34.069150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e07cd60e-6d85-4c58-a56f-71ccd88f3f62 None None] MFA Rules not processed for user `3a022b80e5eb460b92e4e99728b22770`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:34.070708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e07cd60e-6d85-4c58-a56f-71ccd88f3f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:34.096556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:34.161980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 649/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Sep 15 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:34.171733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d312e4-d701-4f90-baee-530a7c6a29aa None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:34.173531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d5d312e4-d701-4f90-baee-530a7c6a29aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:34.290088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d312e4-d701-4f90-baee-530a7c6a29aa None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:34.374176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e920d0-6df8-4cbd-b19a-46897a7ac5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:34.374937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e920d0-6df8-4cbd-b19a-46897a7ac5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:34.375224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e920d0-6df8-4cbd-b19a-46897a7ac5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:34.375413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e920d0-6df8-4cbd-b19a-46897a7ac5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:34.377103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b3e920d0-6df8-4cbd-b19a-46897a7ac5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:34.444125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:34.504202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e920d0-6df8-4cbd-b19a-46897a7ac5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:34.505653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e920d0-6df8-4cbd-b19a-46897a7ac5c9 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:34.525377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 662/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:50:36.956961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e67f12-1136-4ea9-9c68-4d99c7f69733 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:36.957809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e67f12-1136-4ea9-9c68-4d99c7f69733 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:36.957809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e67f12-1136-4ea9-9c68-4d99c7f69733 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:36.960093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 650/1312] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:36.966861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12dc8-4bc2-453a-ba36-6298eab6e6cb None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:36.967555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12dc8-4bc2-453a-ba36-6298eab6e6cb None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:36.967760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12dc8-4bc2-453a-ba36-6298eab6e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:37.046835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b5c12dc8-4bc2-453a-ba36-6298eab6e6cb None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:37.048015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b5c12dc8-4bc2-453a-ba36-6298eab6e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:37.147724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 663/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:37.429143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e67f12-1136-4ea9-9c68-4d99c7f69733 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:37.430911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b5e67f12-1136-4ea9-9c68-4d99c7f69733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:37.544599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e67f12-1136-4ea9-9c68-4d99c7f69733 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:37.619995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:37.622194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad5d3c-fedf-4601-910d-430bf3802be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:37.622816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5d3c-fedf-4601-910d-430bf3802be3 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:37.623039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5d3c-fedf-4601-910d-430bf3802be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:37.623263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad5d3c-fedf-4601-910d-430bf3802be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:37.625281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-55ad5d3c-fedf-4601-910d-430bf3802be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:37.736624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad5d3c-fedf-4601-910d-430bf3802be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:37.737953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad5d3c-fedf-4601-910d-430bf3802be3 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:37.756785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 651/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:50:40.229764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262b5a-35cb-4124-8120-b4ae1fb27095 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:40.230385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262b5a-35cb-4124-8120-b4ae1fb27095 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:40.230385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e262b5a-35cb-4124-8120-b4ae1fb27095 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:40.231681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 664/1315] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:40.237991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d1a1c-824d-4a43-8b50-896bdbefc262 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:40.238717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d1a1c-824d-4a43-8b50-896bdbefc262 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:40.238867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d1a1c-824d-4a43-8b50-896bdbefc262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:40.308910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a99d1a1c-824d-4a43-8b50-896bdbefc262 None None] MFA Rules not processed for user `17b7b5c47aea4b82aa33ed48b84ce909`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:40.310159 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a99d1a1c-824d-4a43-8b50-896bdbefc262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:40.363753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:40.411500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 652/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:40.695077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262b5a-35cb-4124-8120-b4ae1fb27095 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:40.696787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5e262b5a-35cb-4124-8120-b4ae1fb27095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:40.706766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:40.811405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e262b5a-35cb-4124-8120-b4ae1fb27095 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:40.896188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c149ab-67da-41a5-978b-2443946d5f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:40.896799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c149ab-67da-41a5-978b-2443946d5f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:40.897094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c149ab-67da-41a5-978b-2443946d5f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:40.897363 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c149ab-67da-41a5-978b-2443946d5f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:40.898978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-60c149ab-67da-41a5-978b-2443946d5f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:40.969385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:41.022684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c149ab-67da-41a5-978b-2443946d5f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:41.024221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c149ab-67da-41a5-978b-2443946d5f0d service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:41.053789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 665/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:50:43.777494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584531-e4a0-4bb6-bf98-dd4cf9aee5de None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:43.778349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584531-e4a0-4bb6-bf98-dd4cf9aee5de None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:43.778349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27584531-e4a0-4bb6-bf98-dd4cf9aee5de None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:43.780471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 653/1318] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:43.787472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8c440-944e-4d24-9f2d-0dd38177cd64 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:43.788223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8c440-944e-4d24-9f2d-0dd38177cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:43.788418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8c440-944e-4d24-9f2d-0dd38177cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:43.868384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1ef8c440-944e-4d24-9f2d-0dd38177cd64 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:43.869607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1ef8c440-944e-4d24-9f2d-0dd38177cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:43.976951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 666/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:44.270675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27584531-e4a0-4bb6-bf98-dd4cf9aee5de None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:44.273205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-27584531-e4a0-4bb6-bf98-dd4cf9aee5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:44.402203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27584531-e4a0-4bb6-bf98-dd4cf9aee5de None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:44.481705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce87d3-19e6-4578-b2c5-ba003095b132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:44.482317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce87d3-19e6-4578-b2c5-ba003095b132 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:44.482590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce87d3-19e6-4578-b2c5-ba003095b132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:44.482856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce87d3-19e6-4578-b2c5-ba003095b132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:44.484490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6bce87d3-19e6-4578-b2c5-ba003095b132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:44.491331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:44.599560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce87d3-19e6-4578-b2c5-ba003095b132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:44.601785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce87d3-19e6-4578-b2c5-ba003095b132 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:44.620266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 654/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:50:47.463234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f631b91-9a61-48a7-a7b3-5ccf4de6d5d2 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:47.463803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f631b91-9a61-48a7-a7b3-5ccf4de6d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:47.463803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f631b91-9a61-48a7-a7b3-5ccf4de6d5d2 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:47.465214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 667/1321] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:50:47.471633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d19d9-0bd6-4d59-bdb1-ce17eece0d58 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:47.472208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d19d9-0bd6-4d59-bdb1-ce17eece0d58 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:47.472208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d19d9-0bd6-4d59-bdb1-ce17eece0d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:47.550654 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-175d19d9-0bd6-4d59-bdb1-ce17eece0d58 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:47.551951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-175d19d9-0bd6-4d59-bdb1-ce17eece0d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:47.615048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:47.657453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 655/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:47.947810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582251-d128-4709-b6df-984915e51359 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:47.948394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582251-d128-4709-b6df-984915e51359 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:47.948964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54582251-d128-4709-b6df-984915e51359 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:47.951206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 668/1323] 10.222.0.42 () {54 vars in 965 bytes} [Thu Sep 15 12:50:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:47.957217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5142-472e-42d7-ab41-bb9c45c25964 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:47.957455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5142-472e-42d7-ab41-bb9c45c25964 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:47.957753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5142-472e-42d7-ab41-bb9c45c25964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:48.036695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ddbf5142-472e-42d7-ab41-bb9c45c25964 None None] MFA Rules not processed for user `3a022b80e5eb460b92e4e99728b22770`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:48.037893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ddbf5142-472e-42d7-ab41-bb9c45c25964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:48.117201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 656/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Sep 15 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:48.126522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582251-d128-4709-b6df-984915e51359 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:48.128128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-54582251-d128-4709-b6df-984915e51359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:48.148837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:48.236896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54582251-d128-4709-b6df-984915e51359 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:48.312929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc750-303d-49cf-809e-62f2c62b4403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:48.313538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc750-303d-49cf-809e-62f2c62b4403 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:48.313808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc750-303d-49cf-809e-62f2c62b4403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:48.314066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc750-303d-49cf-809e-62f2c62b4403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:48.315655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-64afc750-303d-49cf-809e-62f2c62b4403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:48.389580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:48.429156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc750-303d-49cf-809e-62f2c62b4403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:48.431484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc750-303d-49cf-809e-62f2c62b4403 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:48.453326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 669/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:50:50.874758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576084-a13f-4d07-82a3-547de29dfcdf None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:50.875296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576084-a13f-4d07-82a3-547de29dfcdf None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:50.875296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576084-a13f-4d07-82a3-547de29dfcdf None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:50.876630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 657/1326] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:50.882166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536f52-39e0-4eba-9d4a-5f136d449ad3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:50.882737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536f52-39e0-4eba-9d4a-5f136d449ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:50.882737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536f52-39e0-4eba-9d4a-5f136d449ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:50.956255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c0536f52-39e0-4eba-9d4a-5f136d449ad3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:50.957471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c0536f52-39e0-4eba-9d4a-5f136d449ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:51.068624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 670/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:51.347223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576084-a13f-4d07-82a3-547de29dfcdf None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:51.348798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-57576084-a13f-4d07-82a3-547de29dfcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:51.411420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:51.462691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576084-a13f-4d07-82a3-547de29dfcdf None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:51.541664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340d27f-eb8c-41c0-b6d3-0c9f58d9108c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:51.542281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340d27f-eb8c-41c0-b6d3-0c9f58d9108c service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:51.542530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340d27f-eb8c-41c0-b6d3-0c9f58d9108c service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:51.542796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340d27f-eb8c-41c0-b6d3-0c9f58d9108c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:51.544444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f340d27f-eb8c-41c0-b6d3-0c9f58d9108c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:51.659632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:51.662448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340d27f-eb8c-41c0-b6d3-0c9f58d9108c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:51.664123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340d27f-eb8c-41c0-b6d3-0c9f58d9108c service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:51.686219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 658/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:50:53.892732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa03e-afdb-4917-b99d-fa43ae4d27ad None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:53.893176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa03e-afdb-4917-b99d-fa43ae4d27ad None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:53.893176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa03e-afdb-4917-b99d-fa43ae4d27ad None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:53.894548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 671/1329] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:53.900435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b34f2-ce29-4bcd-a058-97c51be2c2df None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:53.900932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b34f2-ce29-4bcd-a058-97c51be2c2df None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:53.901054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b34f2-ce29-4bcd-a058-97c51be2c2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:53.974871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5a8b34f2-ce29-4bcd-a058-97c51be2c2df None None] MFA Rules not processed for user `17b7b5c47aea4b82aa33ed48b84ce909`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:53.976304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5a8b34f2-ce29-4bcd-a058-97c51be2c2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:54.074566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 659/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:54.350805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa03e-afdb-4917-b99d-fa43ae4d27ad None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:54.352457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-849fa03e-afdb-4917-b99d-fa43ae4d27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:54.385898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:54.467006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa03e-afdb-4917-b99d-fa43ae4d27ad None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:54.547489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168447ed-a7ef-4c75-851c-c2f7b615345a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:54.548192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168447ed-a7ef-4c75-851c-c2f7b615345a service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:54.548468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168447ed-a7ef-4c75-851c-c2f7b615345a service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:54.548730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168447ed-a7ef-4c75-851c-c2f7b615345a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:54.550385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-168447ed-a7ef-4c75-851c-c2f7b615345a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:54.631344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:54.663899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168447ed-a7ef-4c75-851c-c2f7b615345a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:54.665351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168447ed-a7ef-4c75-851c-c2f7b615345a service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:54.686665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 672/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:50:57.260169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edaf6-c0cc-420f-98e0-21c878fc53b4 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:57.260776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edaf6-c0cc-420f-98e0-21c878fc53b4 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:57.260776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edaf6-c0cc-420f-98e0-21c878fc53b4 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:57.262065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 660/1332] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:50:57.268431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf71893-a013-4ff3-a090-0654425da765 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:57.269197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf71893-a013-4ff3-a090-0654425da765 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:57.269326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf71893-a013-4ff3-a090-0654425da765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:57.349777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-abf71893-a013-4ff3-a090-0654425da765 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:50:57.351052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-abf71893-a013-4ff3-a090-0654425da765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:57.465434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 673/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:50:57.744017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39edaf6-c0cc-420f-98e0-21c878fc53b4 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:50:57.745580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c39edaf6-c0cc-420f-98e0-21c878fc53b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:57.817240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:57.863356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39edaf6-c0cc-420f-98e0-21c878fc53b4 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:50:57.941677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc069f-5e8a-4f54-b407-e3dc75847c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:50:57.942289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc069f-5e8a-4f54-b407-e3dc75847c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:50:57.942564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc069f-5e8a-4f54-b407-e3dc75847c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:50:57.942836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc069f-5e8a-4f54-b407-e3dc75847c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:50:57.944727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-11bc069f-5e8a-4f54-b407-e3dc75847c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:50:58.064588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc069f-5e8a-4f54-b407-e3dc75847c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:50:58.065927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc069f-5e8a-4f54-b407-e3dc75847c2e service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:50:58.076683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:50:58.090972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 661/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:51:00.328492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07715-3adb-4dbc-8019-438b7e041a8f None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:00.329179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07715-3adb-4dbc-8019-438b7e041a8f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:00.329179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d07715-3adb-4dbc-8019-438b7e041a8f None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:00.330415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 674/1335] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:00.339668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564ea7-fecf-4e61-8074-50c55add339b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:00.340451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564ea7-fecf-4e61-8074-50c55add339b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:00.340626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c564ea7-fecf-4e61-8074-50c55add339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:00.417655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3c564ea7-fecf-4e61-8074-50c55add339b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:00.418786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3c564ea7-fecf-4e61-8074-50c55add339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:00.522365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 662/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:00.804463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d07715-3adb-4dbc-8019-438b7e041a8f None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:00.806026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a9d07715-3adb-4dbc-8019-438b7e041a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:00.850709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:00.917191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d07715-3adb-4dbc-8019-438b7e041a8f None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:00.995620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdeba4a-3c99-4671-9461-90ac7a4bc40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:00.996266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeba4a-3c99-4671-9461-90ac7a4bc40a service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:00.996539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeba4a-3c99-4671-9461-90ac7a4bc40a service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:00.996805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdeba4a-3c99-4671-9461-90ac7a4bc40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:00.998400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ecdeba4a-3c99-4671-9461-90ac7a4bc40a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:01.096133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:01.123906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeba4a-3c99-4671-9461-90ac7a4bc40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:01.125357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdeba4a-3c99-4671-9461-90ac7a4bc40a service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:01.145276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 675/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:51:03.794135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039360f3-d5d0-4c4d-871f-75ec526d7163 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:03.795005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039360f3-d5d0-4c4d-871f-75ec526d7163 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:03.795005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039360f3-d5d0-4c4d-871f-75ec526d7163 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:03.797078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 663/1338] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:03.802600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cab6b-961c-441b-83b9-2738073f0e86 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:03.803020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cab6b-961c-441b-83b9-2738073f0e86 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:03.803190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cab6b-961c-441b-83b9-2738073f0e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:03.873357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-633cab6b-961c-441b-83b9-2738073f0e86 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:03.874567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-633cab6b-961c-441b-83b9-2738073f0e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:03.977761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 676/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:04.258806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039360f3-d5d0-4c4d-871f-75ec526d7163 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:04.261342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-039360f3-d5d0-4c4d-871f-75ec526d7163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:04.344904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:04.373227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039360f3-d5d0-4c4d-871f-75ec526d7163 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:04.455944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fc763-bf41-49ec-b42b-58e7cdc14b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:04.456562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fc763-bf41-49ec-b42b-58e7cdc14b7b service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:04.456833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fc763-bf41-49ec-b42b-58e7cdc14b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:04.457100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fc763-bf41-49ec-b42b-58e7cdc14b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:04.458695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b65fc763-bf41-49ec-b42b-58e7cdc14b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:04.571803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fc763-bf41-49ec-b42b-58e7cdc14b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:04.573159 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fc763-bf41-49ec-b42b-58e7cdc14b7b service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:04.591929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 664/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:09.050640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec6d6-42b9-4d29-821d-b99cb422368b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:09.051191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec6d6-42b9-4d29-821d-b99cb422368b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:09.051191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec6d6-42b9-4d29-821d-b99cb422368b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:09.052459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 677/1341] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:09.057977 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ccf9-3780-464d-9334-d9990ffc0bbd None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:09.058440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ccf9-3780-464d-9334-d9990ffc0bbd None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:09.058550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ccf9-3780-464d-9334-d9990ffc0bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:09.064241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:09.126758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4d19ccf9-3780-464d-9334-d9990ffc0bbd None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:09.127999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4d19ccf9-3780-464d-9334-d9990ffc0bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:09.243020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 665/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:09.530633 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaec6d6-42b9-4d29-821d-b99cb422368b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:09.532258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-efaec6d6-42b9-4d29-821d-b99cb422368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:09.581619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:09.638776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaec6d6-42b9-4d29-821d-b99cb422368b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:09.711821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb334b30-d9dc-4c3b-b85b-2ac34d8f8b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:09.712400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb334b30-d9dc-4c3b-b85b-2ac34d8f8b6a service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:09.712691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb334b30-d9dc-4c3b-b85b-2ac34d8f8b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:09.712917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb334b30-d9dc-4c3b-b85b-2ac34d8f8b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:09.714506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bb334b30-d9dc-4c3b-b85b-2ac34d8f8b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:09.811267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:09.830315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb334b30-d9dc-4c3b-b85b-2ac34d8f8b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:09.830315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb334b30-d9dc-4c3b-b85b-2ac34d8f8b6a service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:09.848979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 678/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:51:12.613270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb25d-f2ae-4df2-840d-ef4b895c148c None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:12.613830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb25d-f2ae-4df2-840d-ef4b895c148c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:12.613830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb25d-f2ae-4df2-840d-ef4b895c148c None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:12.615281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 666/1344] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:12.620741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c662f-ff7c-429a-826d-c61ad72f518c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:12.621209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c662f-ff7c-429a-826d-c61ad72f518c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:12.621297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c662f-ff7c-429a-826d-c61ad72f518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:12.687717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-050c662f-ff7c-429a-826d-c61ad72f518c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:12.688912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-050c662f-ff7c-429a-826d-c61ad72f518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:12.788589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 679/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:13.068178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb25d-f2ae-4df2-840d-ef4b895c148c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:13.069743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ff7bb25d-f2ae-4df2-840d-ef4b895c148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:13.169729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:13.188181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb25d-f2ae-4df2-840d-ef4b895c148c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:13.269160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b55959-691c-4718-8376-22706c9a755d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:13.269671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55959-691c-4718-8376-22706c9a755d service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:13.269940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55959-691c-4718-8376-22706c9a755d service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:13.270207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55959-691c-4718-8376-22706c9a755d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:13.272139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-78b55959-691c-4718-8376-22706c9a755d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:13.389754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b55959-691c-4718-8376-22706c9a755d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:13.391198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b55959-691c-4718-8376-22706c9a755d service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:13.410878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 667/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:17.869478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538e40-adf8-4c86-8246-c06360983178 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:17.870021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538e40-adf8-4c86-8246-c06360983178 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:17.870021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86538e40-adf8-4c86-8246-c06360983178 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:17.871568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 680/1347] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:51:17.877122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841640-e115-4173-9673-8a1daab4a832 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:17.877602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841640-e115-4173-9673-8a1daab4a832 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:17.877691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841640-e115-4173-9673-8a1daab4a832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:17.894095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:17.947608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b1841640-e115-4173-9673-8a1daab4a832 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:17.948788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b1841640-e115-4173-9673-8a1daab4a832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:18.049832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 668/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:18.334694 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538e40-adf8-4c86-8246-c06360983178 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:18.337286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-86538e40-adf8-4c86-8246-c06360983178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:18.401305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:18.450419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86538e40-adf8-4c86-8246-c06360983178 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:18.531408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdd473-e2ab-49d1-9e8c-352aa10a5fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:18.532022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd473-e2ab-49d1-9e8c-352aa10a5fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:18.532255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd473-e2ab-49d1-9e8c-352aa10a5fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:18.532561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd473-e2ab-49d1-9e8c-352aa10a5fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:18.534143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b5cdd473-e2ab-49d1-9e8c-352aa10a5fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:18.646181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:18.650938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdd473-e2ab-49d1-9e8c-352aa10a5fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:18.652429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdd473-e2ab-49d1-9e8c-352aa10a5fcc service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:18.671417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 681/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:23.664182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304fa7-616f-457b-8993-722a706d70c3 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:23.664182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304fa7-616f-457b-8993-722a706d70c3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:23.664182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304fa7-616f-457b-8993-722a706d70c3 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:23.664182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 669/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:23.668960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca010a-7018-4506-9f50-765c0572c5db None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:23.669392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca010a-7018-4506-9f50-765c0572c5db None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:23.669499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca010a-7018-4506-9f50-765c0572c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:23.822207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-03ca010a-7018-4506-9f50-765c0572c5db None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:23.823822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-03ca010a-7018-4506-9f50-765c0572c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:23.953105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 682/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:51:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:27.938408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd13f-8f70-4539-b381-d371670bd09c None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:27.939392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd13f-8f70-4539-b381-d371670bd09c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:27.939751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edd13f-8f70-4539-b381-d371670bd09c None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:27.941179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 670/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:27.946732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd36d6-483c-4f3e-a4f9-ea6cd7e5a77a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:27.947155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd36d6-483c-4f3e-a4f9-ea6cd7e5a77a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:27.947403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd36d6-483c-4f3e-a4f9-ea6cd7e5a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:28.009574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:28.035145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a5fd36d6-483c-4f3e-a4f9-ea6cd7e5a77a None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:28.036573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a5fd36d6-483c-4f3e-a4f9-ea6cd7e5a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:28.048224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=59 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:28.147992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 683/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:29.658136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e215b4-4e46-48b7-b914-9f4d817e5fe8 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:29.658716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e215b4-4e46-48b7-b914-9f4d817e5fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:29.658716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e215b4-4e46-48b7-b914-9f4d817e5fe8 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:29.660012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 671/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:29.665747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37cf5a-eb9d-4d9f-861d-d494ec3930f2 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:29.666166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37cf5a-eb9d-4d9f-861d-d494ec3930f2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:29.666297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37cf5a-eb9d-4d9f-861d-d494ec3930f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:29.749028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3d37cf5a-eb9d-4d9f-861d-d494ec3930f2 None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:29.750184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3d37cf5a-eb9d-4d9f-861d-d494ec3930f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:29.792997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:29.862203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 684/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:51:33.447582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0c823-b201-4d5d-8aba-b2f8da8f4460 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:33.448153 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0c823-b201-4d5d-8aba-b2f8da8f4460 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:33.448153 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0c823-b201-4d5d-8aba-b2f8da8f4460 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:33.449518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 672/1356] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:33.455449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06afa-56d9-4531-bb66-ecab108e3b03 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:33.455961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06afa-56d9-4531-bb66-ecab108e3b03 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:33.456224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d06afa-56d9-4531-bb66-ecab108e3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:33.529107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-10d06afa-56d9-4531-bb66-ecab108e3b03 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:33.530477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-10d06afa-56d9-4531-bb66-ecab108e3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:33.653937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 685/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:51:33.941630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4c2f9-2197-4353-83be-0760300ad5c6 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:33.941879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4c2f9-2197-4353-83be-0760300ad5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:33.942172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4c2f9-2197-4353-83be-0760300ad5c6 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:33.943503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 673/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Sep 15 12:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:33.951085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd33c-4c04-41c6-89db-ad4a3a037562 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:33.952389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd33c-4c04-41c6-89db-ad4a3a037562 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:33.952798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd33c-4c04-41c6-89db-ad4a3a037562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:33.972247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:34.041400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a29cd33c-4c04-41c6-89db-ad4a3a037562 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:34.042609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a29cd33c-4c04-41c6-89db-ad4a3a037562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:34.170287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 686/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Sep 15 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:51:34.178886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4c2f9-2197-4353-83be-0760300ad5c6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:34.180442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-edb4c2f9-2197-4353-83be-0760300ad5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:34.338716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4c2f9-2197-4353-83be-0760300ad5c6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:34.419063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:34.469851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e9af7-b922-434d-be9b-6d654905aa2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:34.470557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e9af7-b922-434d-be9b-6d654905aa2f service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:34.470701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e9af7-b922-434d-be9b-6d654905aa2f service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:34.471162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e9af7-b922-434d-be9b-6d654905aa2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:34.472815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-681e9af7-b922-434d-be9b-6d654905aa2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:34.573727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e9af7-b922-434d-be9b-6d654905aa2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:34.575313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e9af7-b922-434d-be9b-6d654905aa2f service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:34.596588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 674/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:36.973827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2da957-f058-4140-85a4-0efc693eaf04 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:36.974275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2da957-f058-4140-85a4-0efc693eaf04 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:36.974275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2da957-f058-4140-85a4-0efc693eaf04 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:36.980394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 687/1361] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:36.981664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239e39-f444-4c13-b56d-3bb53e4e00bb None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:36.981664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239e39-f444-4c13-b56d-3bb53e4e00bb None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:36.982129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239e39-f444-4c13-b56d-3bb53e4e00bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:37.050742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-1f239e39-f444-4c13-b56d-3bb53e4e00bb None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:37.052027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1f239e39-f444-4c13-b56d-3bb53e4e00bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:37.090917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:37.155218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 675/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:37.444333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2da957-f058-4140-85a4-0efc693eaf04 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:37.446301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7d2da957-f058-4140-85a4-0efc693eaf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:37.527083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:37.642619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2da957-f058-4140-85a4-0efc693eaf04 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:37.782629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e744a9-8163-4905-beab-826f3c9e75c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:37.783282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e744a9-8163-4905-beab-826f3c9e75c8 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:37.783558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e744a9-8163-4905-beab-826f3c9e75c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:37.783855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e744a9-8163-4905-beab-826f3c9e75c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:37.785453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-15e744a9-8163-4905-beab-826f3c9e75c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:37.809662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:37.883667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e744a9-8163-4905-beab-826f3c9e75c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:37.885333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e744a9-8163-4905-beab-826f3c9e75c8 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:37.904197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 688/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:40.407809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3814dfa-d35e-4f69-a678-13538d57d09d None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:40.408370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3814dfa-d35e-4f69-a678-13538d57d09d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:40.408370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3814dfa-d35e-4f69-a678-13538d57d09d None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:40.409932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 676/1364] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:40.415363 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa44f4-556d-4752-9d19-30209ac47b0f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:40.415860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa44f4-556d-4752-9d19-30209ac47b0f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:40.415944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa44f4-556d-4752-9d19-30209ac47b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:40.485998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c2aa44f4-556d-4752-9d19-30209ac47b0f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:40.487205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c2aa44f4-556d-4752-9d19-30209ac47b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:40.586479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:40.593118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 689/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:40.877701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76e7f4-2051-416c-9870-8504177f0506 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:40.877985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76e7f4-2051-416c-9870-8504177f0506 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:40.878469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76e7f4-2051-416c-9870-8504177f0506 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:40.880582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 677/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Sep 15 12:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:40.886245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c47dc-c686-496b-a24a-86dac66fdd7a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:40.886632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c47dc-c686-496b-a24a-86dac66fdd7a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:40.887004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c47dc-c686-496b-a24a-86dac66fdd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:40.966329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-388c47dc-c686-496b-a24a-86dac66fdd7a None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:40.968059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-388c47dc-c686-496b-a24a-86dac66fdd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:41.092767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 690/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Sep 15 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:41.094000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76e7f4-2051-416c-9870-8504177f0506 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:41.095563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4b76e7f4-2051-416c-9870-8504177f0506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:41.253767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76e7f4-2051-416c-9870-8504177f0506 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:41.275013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:41.375594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4db1c-7803-4fcb-80c7-036e3aa75138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:41.376243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4db1c-7803-4fcb-80c7-036e3aa75138 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:41.376526 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4db1c-7803-4fcb-80c7-036e3aa75138 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:41.376791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4db1c-7803-4fcb-80c7-036e3aa75138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:41.378428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-91c4db1c-7803-4fcb-80c7-036e3aa75138 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:41.556864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc6aa1-d325-43c0-bb24-7f51427c9bdd None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:41.557409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc6aa1-d325-43c0-bb24-7f51427c9bdd None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:41.557815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc6aa1-d325-43c0-bb24-7f51427c9bdd None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:41.559444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 691/1368] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:41.564699 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc5c3f-9bfc-413f-94f9-46a274b8f4a3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:41.564953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc5c3f-9bfc-413f-94f9-46a274b8f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:41.565235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc5c3f-9bfc-413f-94f9-46a274b8f4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:41.621362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4db1c-7803-4fcb-80c7-036e3aa75138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:41.623661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4db1c-7803-4fcb-80c7-036e3aa75138 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:41.634174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:41.643907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 678/1369] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:51:41.644395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-efcc5c3f-9bfc-413f-94f9-46a274b8f4a3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:41.645904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-efcc5c3f-9bfc-413f-94f9-46a274b8f4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:41.754438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 692/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:51:42.048627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf26c8-8692-4a8d-b752-24ca7fb6c2e5 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:42.048949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf26c8-8692-4a8d-b752-24ca7fb6c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:42.049127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf26c8-8692-4a8d-b752-24ca7fb6c2e5 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:42.050681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 679/1371] 10.222.0.42 () {54 vars in 964 bytes} [Thu Sep 15 12:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:42.056299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a16bb-4b7c-42a2-9c9b-e15bdc9bea52 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:42.056710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a16bb-4b7c-42a2-9c9b-e15bdc9bea52 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:42.057244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a16bb-4b7c-42a2-9c9b-e15bdc9bea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:42.148018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c92a16bb-4b7c-42a2-9c9b-e15bdc9bea52 None None] MFA Rules not processed for user `faee06d60a484eebb6a9fb31ce0878d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:42.149599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c92a16bb-4b7c-42a2-9c9b-e15bdc9bea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:42.226225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:42.235874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 693/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Thu Sep 15 12:51:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:42.242591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf26c8-8692-4a8d-b752-24ca7fb6c2e5 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:42.244125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f6bf26c8-8692-4a8d-b752-24ca7fb6c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:42.273853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:42.362283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf26c8-8692-4a8d-b752-24ca7fb6c2e5 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:42.452309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64332449-dad7-4726-8476-ce4a12d97c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:42.452895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332449-dad7-4726-8476-ce4a12d97c6e service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:42.453202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332449-dad7-4726-8476-ce4a12d97c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:42.453419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332449-dad7-4726-8476-ce4a12d97c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:42.455486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-64332449-dad7-4726-8476-ce4a12d97c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:42.541942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:42.584619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64332449-dad7-4726-8476-ce4a12d97c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:42.586514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64332449-dad7-4726-8476-ce4a12d97c6e service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:42.610755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 680/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:43.871297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e9cc-b4e5-4285-a55e-45fac041f021 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:43.871925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e9cc-b4e5-4285-a55e-45fac041f021 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:43.871925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069e9cc-b4e5-4285-a55e-45fac041f021 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:43.873284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 694/1374] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:43.878814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610dc56-7d1f-437e-8cb6-36a1bce0261c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:43.879246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610dc56-7d1f-437e-8cb6-36a1bce0261c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:43.879342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610dc56-7d1f-437e-8cb6-36a1bce0261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:43.949701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c610dc56-7d1f-437e-8cb6-36a1bce0261c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:43.950904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c610dc56-7d1f-437e-8cb6-36a1bce0261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:44.052334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 681/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:44.344445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e9cc-b4e5-4285-a55e-45fac041f021 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:44.345978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3069e9cc-b4e5-4285-a55e-45fac041f021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:44.502916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069e9cc-b4e5-4285-a55e-45fac041f021 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:44.575588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:44.628168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c32652-8501-4001-b8c9-d46b420da39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:44.628796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c32652-8501-4001-b8c9-d46b420da39d service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:44.629075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c32652-8501-4001-b8c9-d46b420da39d service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:44.629342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c32652-8501-4001-b8c9-d46b420da39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:44.632037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-36c32652-8501-4001-b8c9-d46b420da39d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:44.727591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c32652-8501-4001-b8c9-d46b420da39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:44.729330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c32652-8501-4001-b8c9-d46b420da39d service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:44.747875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 695/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:46.933810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832895-a8dc-4e6d-9793-93b7d36eb91a None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:46.934382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832895-a8dc-4e6d-9793-93b7d36eb91a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:46.934382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7832895-a8dc-4e6d-9793-93b7d36eb91a None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:46.938505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 682/1377] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:46.941056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ffbf-a0d4-4ce1-97a2-8342658e3456 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:46.941504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ffbf-a0d4-4ce1-97a2-8342658e3456 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:46.941600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ffbf-a0d4-4ce1-97a2-8342658e3456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:47.016888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-72d3ffbf-a0d4-4ce1-97a2-8342658e3456 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:47.018266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-72d3ffbf-a0d4-4ce1-97a2-8342658e3456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:47.050296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:47.123442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 696/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:47.412314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832895-a8dc-4e6d-9793-93b7d36eb91a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:47.413835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e7832895-a8dc-4e6d-9793-93b7d36eb91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:47.458681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:47.573597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7832895-a8dc-4e6d-9793-93b7d36eb91a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:47.685670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:47.691751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c82c9b-1c49-4ba1-9605-ab12aaca8580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:47.693040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c82c9b-1c49-4ba1-9605-ab12aaca8580 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:47.693643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c82c9b-1c49-4ba1-9605-ab12aaca8580 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:47.693925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c82c9b-1c49-4ba1-9605-ab12aaca8580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:47.695558 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-02c82c9b-1c49-4ba1-9605-ab12aaca8580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:47.789690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c82c9b-1c49-4ba1-9605-ab12aaca8580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:47.791301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c82c9b-1c49-4ba1-9605-ab12aaca8580 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:47.810393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 683/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:50.039264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50ae9-ce1e-484d-8034-8bf1c4740225 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:50.039818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50ae9-ce1e-484d-8034-8bf1c4740225 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:50.039818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50ae9-ce1e-484d-8034-8bf1c4740225 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:50.041368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 697/1380] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:50.046711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8640237-96fb-4687-ba8f-7f8b6e2d1744 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:50.047139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8640237-96fb-4687-ba8f-7f8b6e2d1744 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:50.047252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8640237-96fb-4687-ba8f-7f8b6e2d1744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:50.150328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f8640237-96fb-4687-ba8f-7f8b6e2d1744 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:50.150617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f8640237-96fb-4687-ba8f-7f8b6e2d1744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:50.232697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:50.266900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 684/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:50.555150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb50ae9-ce1e-484d-8034-8bf1c4740225 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:50.556805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bfb50ae9-ce1e-484d-8034-8bf1c4740225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:50.725769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb50ae9-ce1e-484d-8034-8bf1c4740225 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:50.741141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:50.879065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ca1b3-a9d9-44ee-a54a-97c3404366d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:50.879751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ca1b3-a9d9-44ee-a54a-97c3404366d2 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:50.880180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ca1b3-a9d9-44ee-a54a-97c3404366d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:50.880449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ca1b3-a9d9-44ee-a54a-97c3404366d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:50.882381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8a6ca1b3-a9d9-44ee-a54a-97c3404366d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:50.981474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ca1b3-a9d9-44ee-a54a-97c3404366d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:50.983071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ca1b3-a9d9-44ee-a54a-97c3404366d2 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:51.002507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 698/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:53.521028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff6ea-60fb-422e-92e1-809778846719 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:53.521654 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff6ea-60fb-422e-92e1-809778846719 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:53.522455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bff6ea-60fb-422e-92e1-809778846719 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:53.524514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 685/1383] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:53.530068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fb1e7-7a7a-45fb-ac43-b7b31181aefe None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:53.530588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fb1e7-7a7a-45fb-ac43-b7b31181aefe None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:53.530588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fb1e7-7a7a-45fb-ac43-b7b31181aefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:53.554369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:53.615207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5c9fb1e7-7a7a-45fb-ac43-b7b31181aefe None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:53.624036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5c9fb1e7-7a7a-45fb-ac43-b7b31181aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:53.743526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 699/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:51:54.065260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bff6ea-60fb-422e-92e1-809778846719 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:54.069411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-15bff6ea-60fb-422e-92e1-809778846719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:54.240027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bff6ea-60fb-422e-92e1-809778846719 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:54.295766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:54.368284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d33a1-9408-4fca-b448-97ce6601aa1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:54.369069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d33a1-9408-4fca-b448-97ce6601aa1d service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:54.369403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d33a1-9408-4fca-b448-97ce6601aa1d service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:54.369751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d33a1-9408-4fca-b448-97ce6601aa1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:54.371787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-109d33a1-9408-4fca-b448-97ce6601aa1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:54.474170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d33a1-9408-4fca-b448-97ce6601aa1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:54.475873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d33a1-9408-4fca-b448-97ce6601aa1d service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:54.494380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 686/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:56.687194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a81b6-fe12-4404-9f36-ac85958db3db None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:56.687971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a81b6-fe12-4404-9f36-ac85958db3db None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:56.687971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a81b6-fe12-4404-9f36-ac85958db3db None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:56.689137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 700/1386] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:56.695646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88eff-3f99-4198-bfb1-18f2751d3303 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:56.696265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88eff-3f99-4198-bfb1-18f2751d3303 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:56.696265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b88eff-3f99-4198-bfb1-18f2751d3303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:56.764328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-56b88eff-3f99-4198-bfb1-18f2751d3303 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:56.765535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-56b88eff-3f99-4198-bfb1-18f2751d3303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:56.773879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:56.860789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 687/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:57.146730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a81b6-fe12-4404-9f36-ac85958db3db None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:57.148416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ef2a81b6-fe12-4404-9f36-ac85958db3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:57.245522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:57.302162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a81b6-fe12-4404-9f36-ac85958db3db None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:57.418997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b385cc0-2fc9-4ec1-8572-3faed464444f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:57.419524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b385cc0-2fc9-4ec1-8572-3faed464444f service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:57.419823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b385cc0-2fc9-4ec1-8572-3faed464444f service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:57.420087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b385cc0-2fc9-4ec1-8572-3faed464444f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:57.421672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8b385cc0-2fc9-4ec1-8572-3faed464444f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:57.488088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:57.519726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b385cc0-2fc9-4ec1-8572-3faed464444f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:57.521356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b385cc0-2fc9-4ec1-8572-3faed464444f service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:57.540003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 701/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:57.968346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b528a-6245-4987-834d-55e2185b2f51 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:57.968972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b528a-6245-4987-834d-55e2185b2f51 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:57.968972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b528a-6245-4987-834d-55e2185b2f51 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:57.970214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 688/1389] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:57.975595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070efa-7d50-4ff1-96a8-599d19100121 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:57.976119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070efa-7d50-4ff1-96a8-599d19100121 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:57.976119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070efa-7d50-4ff1-96a8-599d19100121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:58.043872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c5070efa-7d50-4ff1-96a8-599d19100121 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:58.045104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c5070efa-7d50-4ff1-96a8-599d19100121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:58.149372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 702/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:58.446222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c26b3-3bb1-4f9c-b589-c4ba732529e9 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:58.446454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c26b3-3bb1-4f9c-b589-c4ba732529e9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:58.446746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c26b3-3bb1-4f9c-b589-c4ba732529e9 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:58.448180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 689/1391] 10.222.0.42 () {54 vars in 962 bytes} [Thu Sep 15 12:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:51:58.454463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21fb52-6f93-4461-90dd-cfddb0c9406d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:58.454725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21fb52-6f93-4461-90dd-cfddb0c9406d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:58.455003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21fb52-6f93-4461-90dd-cfddb0c9406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:58.505813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:58.540271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1d21fb52-6f93-4461-90dd-cfddb0c9406d None None] MFA Rules not processed for user `6083dd9ef4544aa6a596915f5b899b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:58.541480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1d21fb52-6f93-4461-90dd-cfddb0c9406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:58.623146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 703/1392] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Sep 15 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:58.632885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c26b3-3bb1-4f9c-b589-c4ba732529e9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:51:58.634399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d73c26b3-3bb1-4f9c-b589-c4ba732529e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:58.738794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c26b3-3bb1-4f9c-b589-c4ba732529e9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:51:58.777346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:58.813935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8dcba-9344-4a0a-9435-7401c9bce7a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:51:58.814561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8dcba-9344-4a0a-9435-7401c9bce7a4 service glance] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:58.814810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8dcba-9344-4a0a-9435-7401c9bce7a4 service glance] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:58.815069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8dcba-9344-4a0a-9435-7401c9bce7a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:58.816683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6eb8dcba-9344-4a0a-9435-7401c9bce7a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:58.930783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8dcba-9344-4a0a-9435-7401c9bce7a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:51:58.932350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8dcba-9344-4a0a-9435-7401c9bce7a4 service glance] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:51:58.950715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 690/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:51:59.709371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9eba9-c4e5-46e7-9fb7-bf89557ffea4 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:59.709884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9eba9-c4e5-46e7-9fb7-bf89557ffea4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:59.710155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9eba9-c4e5-46e7-9fb7-bf89557ffea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:59.720566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12676e-e3e3-4e3a-b80c-fda016dac166 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:59.721090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12676e-e3e3-4e3a-b80c-fda016dac166 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:59.721090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12676e-e3e3-4e3a-b80c-fda016dac166 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:59.722465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 691/1394] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:59.727864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2b5f-1a16-423e-82b7-ebf02ae5eb19 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:59.728158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2b5f-1a16-423e-82b7-ebf02ae5eb19 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:59.728428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2b5f-1a16-423e-82b7-ebf02ae5eb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:59.782522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-aed9eba9-c4e5-46e7-9fb7-bf89557ffea4 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:59.783731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-aed9eba9-c4e5-46e7-9fb7-bf89557ffea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:59.798903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-bebd2b5f-1a16-423e-82b7-ebf02ae5eb19 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:51:59.800121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bebd2b5f-1a16-423e-82b7-ebf02ae5eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:51:59.818809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:59.875338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:51:59.887844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 704/1395] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:51:59.921925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 692/1396] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:51:59.938693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634be37-3ab2-4b4d-826c-5bd739b1a667 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:59.939724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634be37-3ab2-4b4d-826c-5bd739b1a667 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:59.939724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634be37-3ab2-4b4d-826c-5bd739b1a667 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:51:59.940851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 705/1397] 10.222.0.42 () {54 vars in 943 bytes} [Thu Sep 15 12:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:51:59.948093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:51:59.948372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:51:59.948826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:00.044096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] MFA Rules not processed for user `75b6057e2fd7438cb3fa2a0ec2933fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:00.046053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:00.161343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:00.190091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 693/1398] 10.222.0.42 () {58 vars in 1040 bytes} [Thu Sep 15 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:00.199964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634be37-3ab2-4b4d-826c-5bd739b1a667 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:00.201423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b634be37-3ab2-4b4d-826c-5bd739b1a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:00.334340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:00.335688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:00.339454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634be37-3ab2-4b4d-826c-5bd739b1a667 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:00.418275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:00.434360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0e06c-4400-49cc-9d42-dd5795e04129 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:00.451066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30087a-ae2a-4cc2-b1d7-6d34bf29004f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:00.451619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30087a-ae2a-4cc2-b1d7-6d34bf29004f service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:00.451929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30087a-ae2a-4cc2-b1d7-6d34bf29004f service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:00.452193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30087a-ae2a-4cc2-b1d7-6d34bf29004f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:00.453838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9e30087a-ae2a-4cc2-b1d7-6d34bf29004f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:00.538133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30087a-ae2a-4cc2-b1d7-6d34bf29004f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:00.539850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30087a-ae2a-4cc2-b1d7-6d34bf29004f service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:00.547515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:00.549037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 706/1399] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 12:52:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:52:00.568394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc917177-df88-4b3a-9a64-772b88e343f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:00.569539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc917177-df88-4b3a-9a64-772b88e343f7 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:00.569858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc917177-df88-4b3a-9a64-772b88e343f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:00.569995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc917177-df88-4b3a-9a64-772b88e343f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:00.571688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-cc917177-df88-4b3a-9a64-772b88e343f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:00.686244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc917177-df88-4b3a-9a64-772b88e343f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:00.688004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc917177-df88-4b3a-9a64-772b88e343f7 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:00.707543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 694/1400] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:03.034339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fd316-5a72-48c5-bbe7-b7995fdedfd4 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:03.034925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fd316-5a72-48c5-bbe7-b7995fdedfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:03.034925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fd316-5a72-48c5-bbe7-b7995fdedfd4 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:03.036385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 707/1401] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:03.041629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365043-376d-46d1-8217-7be1d902df66 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:03.042087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365043-376d-46d1-8217-7be1d902df66 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:03.042183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4365043-376d-46d1-8217-7be1d902df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:03.115656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a4365043-376d-46d1-8217-7be1d902df66 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:03.117286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a4365043-376d-46d1-8217-7be1d902df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:03.185680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:03.228806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 695/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:03.510984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fd316-5a72-48c5-bbe7-b7995fdedfd4 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:03.512906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-583fd316-5a72-48c5-bbe7-b7995fdedfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:03.644702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:03.686107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fd316-5a72-48c5-bbe7-b7995fdedfd4 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:03.830371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9887d8-8759-4528-a015-f2c594a7f3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:03.831018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9887d8-8759-4528-a015-f2c594a7f3a2 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:03.831291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9887d8-8759-4528-a015-f2c594a7f3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:03.831555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9887d8-8759-4528-a015-f2c594a7f3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:03.833203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3e9887d8-8759-4528-a015-f2c594a7f3a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:03.915616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:03.929980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9887d8-8759-4528-a015-f2c594a7f3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:03.931716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9887d8-8759-4528-a015-f2c594a7f3a2 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:03.950980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 708/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:06.170421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e386-c11f-41b7-92e7-a82964b824a4 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:06.171010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e386-c11f-41b7-92e7-a82964b824a4 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:06.171010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e386-c11f-41b7-92e7-a82964b824a4 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:06.172494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 696/1404] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:06.177613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cf3b-7e4d-4c8d-8e08-66b94ce12137 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:06.178064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cf3b-7e4d-4c8d-8e08-66b94ce12137 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:06.178198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cf3b-7e4d-4c8d-8e08-66b94ce12137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:06.249972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9212cf3b-7e4d-4c8d-8e08-66b94ce12137 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:06.251188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9212cf3b-7e4d-4c8d-8e08-66b94ce12137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:06.355982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 709/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:06.642251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7e386-c11f-41b7-92e7-a82964b824a4 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:06.643819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-fcb7e386-c11f-41b7-92e7-a82964b824a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:06.802238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7e386-c11f-41b7-92e7-a82964b824a4 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:06.856640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:06.929926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d85a0b-822d-44c7-a3f9-3940ee219a4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:06.930660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d85a0b-822d-44c7-a3f9-3940ee219a4e service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:06.930987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d85a0b-822d-44c7-a3f9-3940ee219a4e service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:06.931313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d85a0b-822d-44c7-a3f9-3940ee219a4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:06.933066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e8d85a0b-822d-44c7-a3f9-3940ee219a4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:07.033170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d85a0b-822d-44c7-a3f9-3940ee219a4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:07.034980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d85a0b-822d-44c7-a3f9-3940ee219a4e service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:07.055972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 697/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:09.303626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7537e0-82b1-4ce3-a882-2742dbbb06a6 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:09.304261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7537e0-82b1-4ce3-a882-2742dbbb06a6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:09.304261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7537e0-82b1-4ce3-a882-2742dbbb06a6 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:09.305610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 710/1407] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:09.311183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527d02-edef-484e-98a4-39d482372ce7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:09.311607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527d02-edef-484e-98a4-39d482372ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:09.311826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527d02-edef-484e-98a4-39d482372ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:09.387442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-64527d02-edef-484e-98a4-39d482372ce7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:09.388699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-64527d02-edef-484e-98a4-39d482372ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:09.391548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:09.501781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 698/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:52:09.803280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7537e0-82b1-4ce3-a882-2742dbbb06a6 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:09.805049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6f7537e0-82b1-4ce3-a882-2742dbbb06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:09.876513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:09.968452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7537e0-82b1-4ce3-a882-2742dbbb06a6 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:10.093472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770eada-d25c-4639-99d9-25ad2f15b1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:10.094856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770eada-d25c-4639-99d9-25ad2f15b1bb service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:10.094856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770eada-d25c-4639-99d9-25ad2f15b1bb service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:10.095004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770eada-d25c-4639-99d9-25ad2f15b1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:10.096815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f770eada-d25c-4639-99d9-25ad2f15b1bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:10.118522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:10.202647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770eada-d25c-4639-99d9-25ad2f15b1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:10.204552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770eada-d25c-4639-99d9-25ad2f15b1bb service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:10.224070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 711/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:19.500480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=41 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:20.221919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=37 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:22.970319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2688b1-500d-4387-ac1f-4fbe3c18062b None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:22.970916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2688b1-500d-4387-ac1f-4fbe3c18062b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:22.970916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2688b1-500d-4387-ac1f-4fbe3c18062b None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:22.972215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 699/1410] 10.222.0.42 () {54 vars in 918 bytes} [Thu Sep 15 12:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:22.979131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22526c3-36d9-4471-9c82-cc478d8ded84 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:22.979562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22526c3-36d9-4471-9c82-cc478d8ded84 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:22.979670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22526c3-36d9-4471-9c82-cc478d8ded84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:23.061616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-d22526c3-36d9-4471-9c82-cc478d8ded84 None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:23.062812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d22526c3-36d9-4471-9c82-cc478d8ded84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:23.178616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 712/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 15 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:23.193679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3016-bf6f-418f-95b5-6a8fdbf758d5 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:23.193934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3016-bf6f-418f-95b5-6a8fdbf758d5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:23.194234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3016-bf6f-418f-95b5-6a8fdbf758d5 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:23.195860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 700/1412] 10.222.0.42 () {54 vars in 918 bytes} [Thu Sep 15 12:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:23.201204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc9ef-5881-4081-8f9e-d4379e443312 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:23.201541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc9ef-5881-4081-8f9e-d4379e443312 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:23.201807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc9ef-5881-4081-8f9e-d4379e443312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:23.279219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:23.284070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-079dc9ef-5881-4081-8f9e-d4379e443312 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:23.286122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-079dc9ef-5881-4081-8f9e-d4379e443312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:23.417644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 713/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Thu Sep 15 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:25.991437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969092-cf30-48fa-abe0-768a613e4dcf None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:25.992176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969092-cf30-48fa-abe0-768a613e4dcf None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:25.992176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969092-cf30-48fa-abe0-768a613e4dcf None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:25.993423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:25.998987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae37ec-07b5-4eaa-aea1-c9bb28763e56 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:25.999433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae37ec-07b5-4eaa-aea1-c9bb28763e56 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:25.999538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae37ec-07b5-4eaa-aea1-c9bb28763e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:26.071343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f8ae37ec-07b5-4eaa-aea1-c9bb28763e56 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:26.072592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f8ae37ec-07b5-4eaa-aea1-c9bb28763e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:26.137781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:26.181271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:26.475506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969092-cf30-48fa-abe0-768a613e4dcf None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:26.477291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-55969092-cf30-48fa-abe0-768a613e4dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:26.631275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969092-cf30-48fa-abe0-768a613e4dcf None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:26.711286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:26.752434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc481130-9ff5-46ea-a5ee-c680c7f39fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:26.753046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481130-9ff5-46ea-a5ee-c680c7f39fdc service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:26.753322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481130-9ff5-46ea-a5ee-c680c7f39fdc service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:26.753587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc481130-9ff5-46ea-a5ee-c680c7f39fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:26.755191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-cc481130-9ff5-46ea-a5ee-c680c7f39fdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:26.854391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc481130-9ff5-46ea-a5ee-c680c7f39fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:26.856006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc481130-9ff5-46ea-a5ee-c680c7f39fdc service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:26.874379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 702/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:28.021836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ef06-46ef-471e-af24-3aefa1334486 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:28.022799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ef06-46ef-471e-af24-3aefa1334486 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:28.022799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ef06-46ef-471e-af24-3aefa1334486 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:28.025161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:28.031717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88d10-ee76-484a-a565-8dddecd2a4ef None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:28.032172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88d10-ee76-484a-a565-8dddecd2a4ef None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:28.032280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c88d10-ee76-484a-a565-8dddecd2a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:28.131260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b8c88d10-ee76-484a-a565-8dddecd2a4ef None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:28.132590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b8c88d10-ee76-484a-a565-8dddecd2a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:28.161410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:28.245028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:28.393814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016ef06-46ef-471e-af24-3aefa1334486 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:28.396135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0016ef06-46ef-471e-af24-3aefa1334486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:28.560571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016ef06-46ef-471e-af24-3aefa1334486 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:28.612376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:28.691878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad51180-080b-4ec6-991b-0d0e5f8744ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:28.692403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51180-080b-4ec6-991b-0d0e5f8744ea service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:28.692671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51180-080b-4ec6-991b-0d0e5f8744ea service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:28.692939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad51180-080b-4ec6-991b-0d0e5f8744ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:28.694545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bad51180-080b-4ec6-991b-0d0e5f8744ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:28.794933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51180-080b-4ec6-991b-0d0e5f8744ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:28.797506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad51180-080b-4ec6-991b-0d0e5f8744ea service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:28.822545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 716/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:29.939877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba439a-8df8-428c-b715-0adeb8fb251d None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:29.940759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba439a-8df8-428c-b715-0adeb8fb251d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:29.940759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba439a-8df8-428c-b715-0adeb8fb251d None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:29.942976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:29.949357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4e42f-e6b0-4c42-b9fc-90435668dda2 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:29.949845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4e42f-e6b0-4c42-b9fc-90435668dda2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:29.949845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4e42f-e6b0-4c42-b9fc-90435668dda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:30.006274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:30.028860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e2c4e42f-e6b0-4c42-b9fc-90435668dda2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:30.030061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e2c4e42f-e6b0-4c42-b9fc-90435668dda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:30.139957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:30.293741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba439a-8df8-428c-b715-0adeb8fb251d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:30.295227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a1ba439a-8df8-428c-b715-0adeb8fb251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:30.464644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba439a-8df8-428c-b715-0adeb8fb251d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:30.478451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:30.591642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf5a72-a867-4e80-9d0e-7f05cacf93df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:30.592203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf5a72-a867-4e80-9d0e-7f05cacf93df service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:30.592478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf5a72-a867-4e80-9d0e-7f05cacf93df service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:30.592744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf5a72-a867-4e80-9d0e-7f05cacf93df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:30.594362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-becf5a72-a867-4e80-9d0e-7f05cacf93df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:30.693881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf5a72-a867-4e80-9d0e-7f05cacf93df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:30.695474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf5a72-a867-4e80-9d0e-7f05cacf93df service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:30.714766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 705/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:31.841879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9b2f1-49e9-4c17-b8b8-037c449121e9 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:31.842791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9b2f1-49e9-4c17-b8b8-037c449121e9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:31.842791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9b2f1-49e9-4c17-b8b8-037c449121e9 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:31.845386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:52:31.854559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7576-3094-44b8-a877-9d0e35f88309 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:31.855025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7576-3094-44b8-a877-9d0e35f88309 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:31.855025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7576-3094-44b8-a877-9d0e35f88309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:31.876083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:31.948393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-883a7576-3094-44b8-a877-9d0e35f88309 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:31.949590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-883a7576-3094-44b8-a877-9d0e35f88309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:32.048415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:52:32.202122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9b2f1-49e9-4c17-b8b8-037c449121e9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:32.204870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c3c9b2f1-49e9-4c17-b8b8-037c449121e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:32.325963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:32.368602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9b2f1-49e9-4c17-b8b8-037c449121e9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:32.485013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb569e-ad2f-4f8f-a58a-16aaa16086b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:32.485621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb569e-ad2f-4f8f-a58a-16aaa16086b8 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:32.485889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb569e-ad2f-4f8f-a58a-16aaa16086b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:32.486153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb569e-ad2f-4f8f-a58a-16aaa16086b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:32.487911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a6bb569e-ad2f-4f8f-a58a-16aaa16086b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:32.566391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:32.580968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb569e-ad2f-4f8f-a58a-16aaa16086b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:32.582499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb569e-ad2f-4f8f-a58a-16aaa16086b8 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:32.605464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 719/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:33.718924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1666-92d0-4069-9e7a-00d6b3a256ff None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:33.719490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1666-92d0-4069-9e7a-00d6b3a256ff None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:33.719490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf1666-92d0-4069-9e7a-00d6b3a256ff None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:33.721122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:52:33.727770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256d8c-7e05-4723-a61f-b592364a0d29 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:33.728251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256d8c-7e05-4723-a61f-b592364a0d29 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:33.728370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d256d8c-7e05-4723-a61f-b592364a0d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:33.809118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0d256d8c-7e05-4723-a61f-b592364a0d29 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:33.810311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0d256d8c-7e05-4723-a61f-b592364a0d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:33.913565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:52:34.077420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1666-92d0-4069-9e7a-00d6b3a256ff None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:34.078872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-85bf1666-92d0-4069-9e7a-00d6b3a256ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:34.189889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:34.264760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf1666-92d0-4069-9e7a-00d6b3a256ff None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:34.384492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be47781-697e-49f5-a2b9-74cbae4811af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:34.385109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be47781-697e-49f5-a2b9-74cbae4811af service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:34.385355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be47781-697e-49f5-a2b9-74cbae4811af service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:34.385634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be47781-697e-49f5-a2b9-74cbae4811af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:34.387232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2be47781-697e-49f5-a2b9-74cbae4811af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:34.439544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:34.498713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be47781-697e-49f5-a2b9-74cbae4811af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:34.500367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be47781-697e-49f5-a2b9-74cbae4811af service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:34.518401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 708/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:35.568525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1f72-7197-4d77-8084-6b18116e5620 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:35.569365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1f72-7197-4d77-8084-6b18116e5620 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:35.569365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c1f72-7197-4d77-8084-6b18116e5620 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:35.571177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:35.577966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e5b1-1673-4a3c-af80-f1b8d8c51856 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:35.578447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e5b1-1673-4a3c-af80-f1b8d8c51856 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:35.578447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e5b1-1673-4a3c-af80-f1b8d8c51856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:35.657346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3905e5b1-1673-4a3c-af80-f1b8d8c51856 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:35.658561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3905e5b1-1673-4a3c-af80-f1b8d8c51856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:35.767481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:52:35.919956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1f72-7197-4d77-8084-6b18116e5620 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:35.921483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-dd1c1f72-7197-4d77-8084-6b18116e5620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:35.971362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:36.071727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c1f72-7197-4d77-8084-6b18116e5620 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:36.190746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e008d-f366-4938-97b1-c044d7dcbe7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:36.191368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e008d-f366-4938-97b1-c044d7dcbe7b service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:36.191638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e008d-f366-4938-97b1-c044d7dcbe7b service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:36.191931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e008d-f366-4938-97b1-c044d7dcbe7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:36.193542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4b5e008d-f366-4938-97b1-c044d7dcbe7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:36.201145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:36.289124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e008d-f366-4938-97b1-c044d7dcbe7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:36.290871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e008d-f366-4938-97b1-c044d7dcbe7b service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:36.311096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 722/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:37.385481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183844-e22b-4299-9e1c-7e0e72749077 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:37.385950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183844-e22b-4299-9e1c-7e0e72749077 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:37.386062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18183844-e22b-4299-9e1c-7e0e72749077 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:37.387382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:37.394736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff98c7-df5d-4701-82c5-7eb3f3fc5d71 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:37.395445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff98c7-df5d-4701-82c5-7eb3f3fc5d71 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:37.395821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff98c7-df5d-4701-82c5-7eb3f3fc5d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:37.477963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2eff98c7-df5d-4701-82c5-7eb3f3fc5d71 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:37.479179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2eff98c7-df5d-4701-82c5-7eb3f3fc5d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:37.563860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:37.593916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:37.749080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18183844-e22b-4299-9e1c-7e0e72749077 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:37.751344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-18183844-e22b-4299-9e1c-7e0e72749077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:37.772878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:37.921915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18183844-e22b-4299-9e1c-7e0e72749077 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:38.013761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:38.040428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfab75d-8e23-459a-a021-a63ba76aed60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:38.041044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab75d-8e23-459a-a021-a63ba76aed60 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:38.041321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab75d-8e23-459a-a021-a63ba76aed60 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:38.041592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab75d-8e23-459a-a021-a63ba76aed60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:38.043212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0bfab75d-8e23-459a-a021-a63ba76aed60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:38.154254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfab75d-8e23-459a-a021-a63ba76aed60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:38.157428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfab75d-8e23-459a-a021-a63ba76aed60 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:38.182108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 711/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:39.221614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53f18-eb9f-4f96-be44-3c2749a9c4c9 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:39.222225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53f18-eb9f-4f96-be44-3c2749a9c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:39.222225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac53f18-eb9f-4f96-be44-3c2749a9c4c9 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:39.223516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:39.230221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6507dd-a485-4a6e-8f10-fe3f6bc3f297 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:39.230706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6507dd-a485-4a6e-8f10-fe3f6bc3f297 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:39.230706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6507dd-a485-4a6e-8f10-fe3f6bc3f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:39.318230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9f6507dd-a485-4a6e-8f10-fe3f6bc3f297 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:39.319456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9f6507dd-a485-4a6e-8f10-fe3f6bc3f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:39.366729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:39.424906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:39.574322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53f18-eb9f-4f96-be44-3c2749a9c4c9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:39.575884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bac53f18-eb9f-4f96-be44-3c2749a9c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:39.728551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac53f18-eb9f-4f96-be44-3c2749a9c4c9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:39.785990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:39.851469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d474c-773a-422c-834c-f17470afceb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:39.852423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d474c-773a-422c-834c-f17470afceb5 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:39.852577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d474c-773a-422c-834c-f17470afceb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:39.852759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d474c-773a-422c-834c-f17470afceb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:39.854370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1d9d474c-773a-422c-834c-f17470afceb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:39.954552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d474c-773a-422c-834c-f17470afceb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:39.956207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d474c-773a-422c-834c-f17470afceb5 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:39.974630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 725/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:41.051138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117563-4bfd-4d12-9ffa-c81d3d59025c None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:41.051786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117563-4bfd-4d12-9ffa-c81d3d59025c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:41.051786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4117563-4bfd-4d12-9ffa-c81d3d59025c None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:41.053052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:41.060417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb91c-23a6-4ea3-ae11-c7b1a2794acd None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:41.060877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb91c-23a6-4ea3-ae11-c7b1a2794acd None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:41.060995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb91c-23a6-4ea3-ae11-c7b1a2794acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:41.142718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1a1cb91c-23a6-4ea3-ae11-c7b1a2794acd None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:41.143975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1a1cb91c-23a6-4ea3-ae11-c7b1a2794acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:41.146013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:41.247671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:41.411758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117563-4bfd-4d12-9ffa-c81d3d59025c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:41.414130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d4117563-4bfd-4d12-9ffa-c81d3d59025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:41.577830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4117563-4bfd-4d12-9ffa-c81d3d59025c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:41.608599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:41.696917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa2d1-543c-481d-b999-e8f2dad0f873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:41.697409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa2d1-543c-481d-b999-e8f2dad0f873 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:41.697708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa2d1-543c-481d-b999-e8f2dad0f873 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:41.697963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa2d1-543c-481d-b999-e8f2dad0f873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:41.699556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9ccaa2d1-543c-481d-b999-e8f2dad0f873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:41.802616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa2d1-543c-481d-b999-e8f2dad0f873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:41.805109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaa2d1-543c-481d-b999-e8f2dad0f873 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:41.824119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 714/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:43.897723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f0fc-d88f-4d44-82d2-8364707ef0bd None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:43.898709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f0fc-d88f-4d44-82d2-8364707ef0bd None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:43.898709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f0fc-d88f-4d44-82d2-8364707ef0bd None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:43.901709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:52:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:43.910877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326803-aba5-4676-b07f-45d04cac5c74 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:43.911322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326803-aba5-4676-b07f-45d04cac5c74 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:43.911420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326803-aba5-4676-b07f-45d04cac5c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:43.958904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:43.987503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-15326803-aba5-4676-b07f-45d04cac5c74 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:43.988738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-15326803-aba5-4676-b07f-45d04cac5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:44.099244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:44.385724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877f0fc-d88f-4d44-82d2-8364707ef0bd None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:44.388287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b877f0fc-d88f-4d44-82d2-8364707ef0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:44.507671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877f0fc-d88f-4d44-82d2-8364707ef0bd None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:44.541722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:44.587524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe07b0-2e82-4c85-b5ff-83649a5f2983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:44.588177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe07b0-2e82-4c85-b5ff-83649a5f2983 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:44.588458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe07b0-2e82-4c85-b5ff-83649a5f2983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:44.588727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe07b0-2e82-4c85-b5ff-83649a5f2983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:44.590349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-94fe07b0-2e82-4c85-b5ff-83649a5f2983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:44.719723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe07b0-2e82-4c85-b5ff-83649a5f2983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:44.721442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe07b0-2e82-4c85-b5ff-83649a5f2983 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:44.740703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 728/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:47.082288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6f70-864e-4f6d-8580-2aa476c661d9 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:47.083111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6f70-864e-4f6d-8580-2aa476c661d9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:47.083111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6f70-864e-4f6d-8580-2aa476c661d9 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:47.085240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:47.091544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ae0b-14b0-4b5a-bf63-aaebe81c8ab5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:47.092028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ae0b-14b0-4b5a-bf63-aaebe81c8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:47.092139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2ae0b-14b0-4b5a-bf63-aaebe81c8ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:47.166567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b9b2ae0b-14b0-4b5a-bf63-aaebe81c8ab5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:47.167797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b9b2ae0b-14b0-4b5a-bf63-aaebe81c8ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:47.181376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:47.265623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:47.551409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6f70-864e-4f6d-8580-2aa476c661d9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:47.553037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0ecf6f70-864e-4f6d-8580-2aa476c661d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:47.665766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6f70-864e-4f6d-8580-2aa476c661d9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:47.678983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:47.743833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76df15-a46f-4ced-8ee4-2fb9a27b4cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:47.744373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76df15-a46f-4ced-8ee4-2fb9a27b4cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:47.744646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76df15-a46f-4ced-8ee4-2fb9a27b4cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:47.744909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76df15-a46f-4ced-8ee4-2fb9a27b4cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:47.746524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4e76df15-a46f-4ced-8ee4-2fb9a27b4cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:47.858361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76df15-a46f-4ced-8ee4-2fb9a27b4cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:47.859800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76df15-a46f-4ced-8ee4-2fb9a27b4cd0 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:47.879747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 717/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:52:50.346467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed76f-841d-45c8-96dc-b2ef4b46790b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:50.347042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed76f-841d-45c8-96dc-b2ef4b46790b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:50.347042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed76f-841d-45c8-96dc-b2ef4b46790b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:50.348988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:52:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:50.355400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6391ad-2fbb-4dd7-85a4-a7db479b284d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:50.356111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6391ad-2fbb-4dd7-85a4-a7db479b284d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:50.356262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6391ad-2fbb-4dd7-85a4-a7db479b284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:50.415944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:50.435097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2e6391ad-2fbb-4dd7-85a4-a7db479b284d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:50.436346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2e6391ad-2fbb-4dd7-85a4-a7db479b284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:50.537560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:50.821571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ed76f-841d-45c8-96dc-b2ef4b46790b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:50.823147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-326ed76f-841d-45c8-96dc-b2ef4b46790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:50.936379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ed76f-841d-45c8-96dc-b2ef4b46790b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:50.978745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:51.028334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cf975-1556-428c-bf89-5da71bd51d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:51.028944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf975-1556-428c-bf89-5da71bd51d26 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:51.029219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf975-1556-428c-bf89-5da71bd51d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:51.029484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf975-1556-428c-bf89-5da71bd51d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:51.031099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-353cf975-1556-428c-bf89-5da71bd51d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:51.148760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cf975-1556-428c-bf89-5da71bd51d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:51.150204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cf975-1556-428c-bf89-5da71bd51d26 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:51.169897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 731/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:52:53.454532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e14b5-1347-438e-996a-fa6ce93a4323 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:53.455033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e14b5-1347-438e-996a-fa6ce93a4323 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:53.455033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e14b5-1347-438e-996a-fa6ce93a4323 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:53.456479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:53.462173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eba64-f8c4-4cc4-8f2d-ed2abadbae17 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:53.462625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eba64-f8c4-4cc4-8f2d-ed2abadbae17 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:53.462743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eba64-f8c4-4cc4-8f2d-ed2abadbae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:53.531911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-df4eba64-f8c4-4cc4-8f2d-ed2abadbae17 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:53.533117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-df4eba64-f8c4-4cc4-8f2d-ed2abadbae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:53.554547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:53.638129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:53.929814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e14b5-1347-438e-996a-fa6ce93a4323 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:53.931823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5c1e14b5-1347-438e-996a-fa6ce93a4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:54.049587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e14b5-1347-438e-996a-fa6ce93a4323 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:54.075841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:54.135192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2a2c3-10f4-4c2b-a428-34e806d2897a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:54.135834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2a2c3-10f4-4c2b-a428-34e806d2897a service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:54.136107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2a2c3-10f4-4c2b-a428-34e806d2897a service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:54.136372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2a2c3-10f4-4c2b-a428-34e806d2897a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:54.137967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a9f2a2c3-10f4-4c2b-a428-34e806d2897a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:54.255175 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2a2c3-10f4-4c2b-a428-34e806d2897a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:54.256566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2a2c3-10f4-4c2b-a428-34e806d2897a service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:54.276847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 720/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:56.595625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257bde-cc3b-432c-8267-1b121fa6d3f3 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:56.596893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257bde-cc3b-432c-8267-1b121fa6d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:56.596893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd257bde-cc3b-432c-8267-1b121fa6d3f3 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:56.598966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:52:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:56.604780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67c56-6ea7-47c9-92b4-9ebdaaf94471 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:56.605223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67c56-6ea7-47c9-92b4-9ebdaaf94471 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:56.605320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67c56-6ea7-47c9-92b4-9ebdaaf94471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:56.670978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:56.674619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-76d67c56-6ea7-47c9-92b4-9ebdaaf94471 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:56.676304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-76d67c56-6ea7-47c9-92b4-9ebdaaf94471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:56.785275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:52:57.071371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257bde-cc3b-432c-8267-1b121fa6d3f3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:52:57.073320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fd257bde-cc3b-432c-8267-1b121fa6d3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:57.187583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd257bde-cc3b-432c-8267-1b121fa6d3f3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:52:57.243253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:57.269512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb641a8c-00f9-44eb-9e9d-235dabde7311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:52:57.270120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641a8c-00f9-44eb-9e9d-235dabde7311 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:57.270391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641a8c-00f9-44eb-9e9d-235dabde7311 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:57.270680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641a8c-00f9-44eb-9e9d-235dabde7311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:57.272320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-eb641a8c-00f9-44eb-9e9d-235dabde7311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:57.385142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb641a8c-00f9-44eb-9e9d-235dabde7311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:52:57.386583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb641a8c-00f9-44eb-9e9d-235dabde7311 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:52:57.405312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 734/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:52:59.647395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d501b-5339-40af-abc1-3d3a10b5c311 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:59.648307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d501b-5339-40af-abc1-3d3a10b5c311 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:59.648307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d501b-5339-40af-abc1-3d3a10b5c311 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:59.650273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:52:59.656386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141bb3-c43c-4409-9c93-cfad7f38579e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:52:59.656814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141bb3-c43c-4409-9c93-cfad7f38579e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:52:59.656921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2141bb3-c43c-4409-9c93-cfad7f38579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:52:59.733774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-d2141bb3-c43c-4409-9c93-cfad7f38579e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:52:59.734906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d2141bb3-c43c-4409-9c93-cfad7f38579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:52:59.765498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:52:59.837179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:00.134598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d501b-5339-40af-abc1-3d3a10b5c311 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:00.136612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2c0d501b-5339-40af-abc1-3d3a10b5c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:00.249437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d501b-5339-40af-abc1-3d3a10b5c311 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:00.289086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:00.336683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cd9d2-669c-40bc-be95-cb643273d9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:00.337292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd9d2-669c-40bc-be95-cb643273d9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:00.337567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd9d2-669c-40bc-be95-cb643273d9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:00.337829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cd9d2-669c-40bc-be95-cb643273d9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:00.339426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c21cd9d2-669c-40bc-be95-cb643273d9e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:00.464796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cd9d2-669c-40bc-be95-cb643273d9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:00.466240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cd9d2-669c-40bc-be95-cb643273d9e9 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:00.485522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 723/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:02.689381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69e71-b2d0-43f0-a2a0-d7475e29bc0a None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:02.690222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69e71-b2d0-43f0-a2a0-d7475e29bc0a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:02.690222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69e71-b2d0-43f0-a2a0-d7475e29bc0a None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:02.692542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:02.699244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8be307-cae6-449d-9a2d-fcf9e9ef2be0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:02.700056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8be307-cae6-449d-9a2d-fcf9e9ef2be0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:02.700209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8be307-cae6-449d-9a2d-fcf9e9ef2be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:02.774004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-7d8be307-cae6-449d-9a2d-fcf9e9ef2be0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:02.775217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7d8be307-cae6-449d-9a2d-fcf9e9ef2be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:02.784176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:02.876286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:03.160459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69e71-b2d0-43f0-a2a0-d7475e29bc0a None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:03.162923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-cba69e71-b2d0-43f0-a2a0-d7475e29bc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:03.273201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69e71-b2d0-43f0-a2a0-d7475e29bc0a None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:03.336230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:03.355461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63ddfe-1df0-4eca-831c-5ba9c76bc073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:03.356118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ddfe-1df0-4eca-831c-5ba9c76bc073 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:03.356391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ddfe-1df0-4eca-831c-5ba9c76bc073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:03.356653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63ddfe-1df0-4eca-831c-5ba9c76bc073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:03.358245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bb63ddfe-1df0-4eca-831c-5ba9c76bc073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:03.478681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63ddfe-1df0-4eca-831c-5ba9c76bc073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:03.480793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63ddfe-1df0-4eca-831c-5ba9c76bc073 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:03.500117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 737/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:05.692238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad748e-9642-4c6f-b5dd-8375cc9ef4d4 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:05.692808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad748e-9642-4c6f-b5dd-8375cc9ef4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:05.692808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad748e-9642-4c6f-b5dd-8375cc9ef4d4 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:05.694658 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:53:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:05.700711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4c83-5f31-478f-b847-107233d20b89 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:05.701118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4c83-5f31-478f-b847-107233d20b89 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:05.701319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4c83-5f31-478f-b847-107233d20b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:05.780448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a2ec4c83-5f31-478f-b847-107233d20b89 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:05.781659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a2ec4c83-5f31-478f-b847-107233d20b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:05.821756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:05.890319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:06.175206 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad748e-9642-4c6f-b5dd-8375cc9ef4d4 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:06.176817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2bad748e-9642-4c6f-b5dd-8375cc9ef4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:06.287976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad748e-9642-4c6f-b5dd-8375cc9ef4d4 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:06.330206 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:06.376874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dc5ab-4843-44e4-99bc-c9fe193e0b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:06.377480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dc5ab-4843-44e4-99bc-c9fe193e0b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:06.377749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dc5ab-4843-44e4-99bc-c9fe193e0b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:06.378012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dc5ab-4843-44e4-99bc-c9fe193e0b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:06.379596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d06dc5ab-4843-44e4-99bc-c9fe193e0b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:06.497337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dc5ab-4843-44e4-99bc-c9fe193e0b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:06.498777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dc5ab-4843-44e4-99bc-c9fe193e0b8b service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:06.523379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 726/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:08.694426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a416-f446-42c4-b610-a6371634a3cf None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:08.695218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a416-f446-42c4-b610-a6371634a3cf None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:08.695218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a416-f446-42c4-b610-a6371634a3cf None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:08.697425 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:08.704078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabdcef-f1a1-433f-98aa-4ae2f4ca3dd5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:08.704852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabdcef-f1a1-433f-98aa-4ae2f4ca3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:08.705015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabdcef-f1a1-433f-98aa-4ae2f4ca3dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:08.775098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0cabdcef-f1a1-433f-98aa-4ae2f4ca3dd5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:08.776514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0cabdcef-f1a1-433f-98aa-4ae2f4ca3dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:08.795122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:08.882010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:09.184549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a416-f446-42c4-b610-a6371634a3cf None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:09.186221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1806a416-f446-42c4-b610-a6371634a3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:09.329648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a416-f446-42c4-b610-a6371634a3cf None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:09.418086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:09.427391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926d7db-f58c-4c7f-aa0f-df02e1ba5c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:09.427965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926d7db-f58c-4c7f-aa0f-df02e1ba5c96 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:09.428238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926d7db-f58c-4c7f-aa0f-df02e1ba5c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:09.428499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926d7db-f58c-4c7f-aa0f-df02e1ba5c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:09.430149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0926d7db-f58c-4c7f-aa0f-df02e1ba5c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:09.722205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926d7db-f58c-4c7f-aa0f-df02e1ba5c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:09.725676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926d7db-f58c-4c7f-aa0f-df02e1ba5c96 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:09.746720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 740/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:11.998957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20235dec-da77-4d68-8f94-07415327800a None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:11.999537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20235dec-da77-4d68-8f94-07415327800a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:11.999537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20235dec-da77-4d68-8f94-07415327800a None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:12.000901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:12.007376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c809-7a10-487c-958e-4543464252f9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:12.008139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c809-7a10-487c-958e-4543464252f9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:12.008316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c809-7a10-487c-958e-4543464252f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:12.076285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8360c809-7a10-487c-958e-4543464252f9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:12.077512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8360c809-7a10-487c-958e-4543464252f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:12.128827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:12.179950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:12.462774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20235dec-da77-4d68-8f94-07415327800a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:12.464493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-20235dec-da77-4d68-8f94-07415327800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:12.578599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20235dec-da77-4d68-8f94-07415327800a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:12.630364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:12.658097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f28bfd-8054-4fd6-a37d-41b414a45788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:12.658735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28bfd-8054-4fd6-a37d-41b414a45788 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:12.659012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28bfd-8054-4fd6-a37d-41b414a45788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:12.659282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f28bfd-8054-4fd6-a37d-41b414a45788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:12.660958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e6f28bfd-8054-4fd6-a37d-41b414a45788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:12.793561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f28bfd-8054-4fd6-a37d-41b414a45788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:12.794894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f28bfd-8054-4fd6-a37d-41b414a45788 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:12.814902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 729/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:22.178313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=22 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:22.811223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=66 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:32.764182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099edbe8-5507-4194-944f-33dc8534d603 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:32.765106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099edbe8-5507-4194-944f-33dc8534d603 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:32.765106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099edbe8-5507-4194-944f-33dc8534d603 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:32.767140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 742/1471] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:53:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:32.776164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81ed3-fa08-47c5-aa86-7583dafdd794 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:32.776737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81ed3-fa08-47c5-aa86-7583dafdd794 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:32.776926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81ed3-fa08-47c5-aa86-7583dafdd794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:32.846586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2fc81ed3-fa08-47c5-aa86-7583dafdd794 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:32.848168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2fc81ed3-fa08-47c5-aa86-7583dafdd794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:32.949521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 730/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:33.264457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1fad-593b-43d0-bd9b-44cd2ae58bef None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:33.264755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1fad-593b-43d0-bd9b-44cd2ae58bef None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:33.265020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1fad-593b-43d0-bd9b-44cd2ae58bef None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:33.266400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 743/1473] 10.222.0.42 () {54 vars in 962 bytes} [Thu Sep 15 12:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:33.271507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e6ba1-7f30-409d-9d1c-5c58517857fc None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:33.271823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e6ba1-7f30-409d-9d1c-5c58517857fc None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:33.272094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e6ba1-7f30-409d-9d1c-5c58517857fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:33.360259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4c2e6ba1-7f30-409d-9d1c-5c58517857fc None None] MFA Rules not processed for user `6083dd9ef4544aa6a596915f5b899b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:33.361588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4c2e6ba1-7f30-409d-9d1c-5c58517857fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:33.384966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:33.446167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 731/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Sep 15 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:53:33.458104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1fad-593b-43d0-bd9b-44cd2ae58bef None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:33.459620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-380b1fad-593b-43d0-bd9b-44cd2ae58bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:33.577576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1fad-593b-43d0-bd9b-44cd2ae58bef None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:33.660398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75564f8a-b97a-491b-bf9e-a8acc6ea13db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:33.661010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564f8a-b97a-491b-bf9e-a8acc6ea13db service glance] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:33.661292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564f8a-b97a-491b-bf9e-a8acc6ea13db service glance] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:33.661555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564f8a-b97a-491b-bf9e-a8acc6ea13db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:33.663188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-75564f8a-b97a-491b-bf9e-a8acc6ea13db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:33.725152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:33.791835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75564f8a-b97a-491b-bf9e-a8acc6ea13db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:33.793455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75564f8a-b97a-491b-bf9e-a8acc6ea13db service glance] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:33.812129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 744/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:36.025056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411090a-00dc-40f4-98c9-b47a2746519b None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:36.025661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411090a-00dc-40f4-98c9-b47a2746519b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:36.025661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411090a-00dc-40f4-98c9-b47a2746519b None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:36.027102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 732/1476] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:36.033641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265b123-05bb-4a00-ba27-922834df7c83 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:36.034302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265b123-05bb-4a00-ba27-922834df7c83 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:36.034514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265b123-05bb-4a00-ba27-922834df7c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:36.109015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3265b123-05bb-4a00-ba27-922834df7c83 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:36.110311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3265b123-05bb-4a00-ba27-922834df7c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:36.208022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 745/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:36.479050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411090a-00dc-40f4-98c9-b47a2746519b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:36.480670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9411090a-00dc-40f4-98c9-b47a2746519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:36.630355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411090a-00dc-40f4-98c9-b47a2746519b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:36.689422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:36.738525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d78b9-e705-41f5-a1e7-5e13da03b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:36.739050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d78b9-e705-41f5-a1e7-5e13da03b6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:36.739320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d78b9-e705-41f5-a1e7-5e13da03b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:36.739585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d78b9-e705-41f5-a1e7-5e13da03b6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:36.740245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d78b9-e705-41f5-a1e7-5e13da03b6a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:36.741983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-ce4d78b9-e705-41f5-a1e7-5e13da03b6a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:53:36.741983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:53:36.741983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:53:36.743116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d78b9-e705-41f5-a1e7-5e13da03b6a0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:36.763894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 733/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Sep 15 12:53:36 2022] GET /identity/v3/projects => generated 2553 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:53:38.975888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f922ea0-2ff5-4e29-84c2-54f7461461e5 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:38.976809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f922ea0-2ff5-4e29-84c2-54f7461461e5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:38.976809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f922ea0-2ff5-4e29-84c2-54f7461461e5 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:38.978840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 746/1479] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:53:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:38.987644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8e51-0646-4f67-929e-b3addf3bc5ce None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:38.988106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8e51-0646-4f67-929e-b3addf3bc5ce None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:38.988215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec8e51-0646-4f67-929e-b3addf3bc5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:39.061267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ecec8e51-0646-4f67-929e-b3addf3bc5ce None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:39.062480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ecec8e51-0646-4f67-929e-b3addf3bc5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:39.169026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 734/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:39.474995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f922ea0-2ff5-4e29-84c2-54f7461461e5 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:39.476717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6f922ea0-2ff5-4e29-84c2-54f7461461e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:39.489583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:39.630949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f922ea0-2ff5-4e29-84c2-54f7461461e5 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:39.709918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:39.745189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd29e82-b1f8-4c20-9186-f80f6562b776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:39.745873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29e82-b1f8-4c20-9186-f80f6562b776 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:39.746147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29e82-b1f8-4c20-9186-f80f6562b776 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:39.746411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29e82-b1f8-4c20-9186-f80f6562b776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:39.748052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-edd29e82-b1f8-4c20-9186-f80f6562b776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:39.841917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd29e82-b1f8-4c20-9186-f80f6562b776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:39.843504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd29e82-b1f8-4c20-9186-f80f6562b776 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:39.861664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 747/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:42.184196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2538-3425-45a2-a466-305ca39a7e3f None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:42.184831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2538-3425-45a2-a466-305ca39a7e3f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:42.184831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2538-3425-45a2-a466-305ca39a7e3f None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:42.186135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 735/1482] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:42.195243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067203f8-1656-4c67-8ebc-922bbbbf1abe None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:42.196022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067203f8-1656-4c67-8ebc-922bbbbf1abe None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:42.196219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067203f8-1656-4c67-8ebc-922bbbbf1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:42.264153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-067203f8-1656-4c67-8ebc-922bbbbf1abe None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:42.265336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-067203f8-1656-4c67-8ebc-922bbbbf1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:42.324185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:42.376570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 748/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:42.688566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa2538-3425-45a2-a466-305ca39a7e3f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:42.690220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d8aa2538-3425-45a2-a466-305ca39a7e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:42.715707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:42.815139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa2538-3425-45a2-a466-305ca39a7e3f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:42.913470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e9af2-f018-4f9e-a05b-b2bfaed1ac81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:42.914087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e9af2-f018-4f9e-a05b-b2bfaed1ac81 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:42.914356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e9af2-f018-4f9e-a05b-b2bfaed1ac81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:42.914618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e9af2-f018-4f9e-a05b-b2bfaed1ac81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:42.916265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-306e9af2-f018-4f9e-a05b-b2bfaed1ac81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:43.012632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:43.050901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e9af2-f018-4f9e-a05b-b2bfaed1ac81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:43.052407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e9af2-f018-4f9e-a05b-b2bfaed1ac81 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:43.072824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 736/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:45.278059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822986a-cb73-4680-98e6-f1f38f1d5042 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:45.278655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822986a-cb73-4680-98e6-f1f38f1d5042 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:45.278655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822986a-cb73-4680-98e6-f1f38f1d5042 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:45.280372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 749/1485] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:45.286521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3b44-9e43-41b2-a21c-052f9b72b745 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:45.286952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3b44-9e43-41b2-a21c-052f9b72b745 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:45.287088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3b44-9e43-41b2-a21c-052f9b72b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:45.363987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f24c3b44-9e43-41b2-a21c-052f9b72b745 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:45.365199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f24c3b44-9e43-41b2-a21c-052f9b72b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:45.480844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 737/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:45.767498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822986a-cb73-4680-98e6-f1f38f1d5042 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:45.769883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4822986a-cb73-4680-98e6-f1f38f1d5042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:45.889344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822986a-cb73-4680-98e6-f1f38f1d5042 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:45.970716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:45.972397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ac36c-56fc-4d21-ad9f-23ef59bdf6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:45.973450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac36c-56fc-4d21-ad9f-23ef59bdf6bc service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:45.973731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac36c-56fc-4d21-ad9f-23ef59bdf6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:45.974040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ac36c-56fc-4d21-ad9f-23ef59bdf6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:45.976247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a15ac36c-56fc-4d21-ad9f-23ef59bdf6bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:46.089713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac36c-56fc-4d21-ad9f-23ef59bdf6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:46.091071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ac36c-56fc-4d21-ad9f-23ef59bdf6bc service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:46.111223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 750/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:48.393078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00838689-59a3-4af7-9ca6-dd5d528ede4b None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:48.393946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00838689-59a3-4af7-9ca6-dd5d528ede4b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:48.393946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00838689-59a3-4af7-9ca6-dd5d528ede4b None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:48.395879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 738/1488] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:53:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:48.403469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c375-cd60-4895-93ee-36ff4dd1a028 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:48.404231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c375-cd60-4895-93ee-36ff4dd1a028 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:48.404231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4c375-cd60-4895-93ee-36ff4dd1a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:48.472663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4bd4c375-cd60-4895-93ee-36ff4dd1a028 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:48.474200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4bd4c375-cd60-4895-93ee-36ff4dd1a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:48.526960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:48.574976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 751/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:48.867612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00838689-59a3-4af7-9ca6-dd5d528ede4b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:48.870322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-00838689-59a3-4af7-9ca6-dd5d528ede4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:48.916470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:48.990881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00838689-59a3-4af7-9ca6-dd5d528ede4b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:49.069616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe641b8f-ffea-4c90-9112-d63f1507d921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:49.070224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641b8f-ffea-4c90-9112-d63f1507d921 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:49.070497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641b8f-ffea-4c90-9112-d63f1507d921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:49.070762 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641b8f-ffea-4c90-9112-d63f1507d921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:49.072390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-fe641b8f-ffea-4c90-9112-d63f1507d921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:49.158032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:49.193594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe641b8f-ffea-4c90-9112-d63f1507d921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:49.195043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe641b8f-ffea-4c90-9112-d63f1507d921 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:49.214053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 739/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:53:51.668241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90127c-a753-4dd4-ac6e-e24627aad1e2 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:51.668830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90127c-a753-4dd4-ac6e-e24627aad1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:51.668830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90127c-a753-4dd4-ac6e-e24627aad1e2 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:51.670184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 752/1491] 10.222.0.42 () {54 vars in 927 bytes} [Thu Sep 15 12:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:53:51.677035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbce47-8d50-44d6-ae0c-0d2e232f3a91 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:51.677505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbce47-8d50-44d6-ae0c-0d2e232f3a91 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:51.677604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbce47-8d50-44d6-ae0c-0d2e232f3a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:51.754327 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-cfdbce47-8d50-44d6-ae0c-0d2e232f3a91 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:53:51.755457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-cfdbce47-8d50-44d6-ae0c-0d2e232f3a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:51.858510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 740/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Thu Sep 15 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:53:52.169676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90127c-a753-4dd4-ac6e-e24627aad1e2 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:53:52.171283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9b90127c-a753-4dd4-ac6e-e24627aad1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:52.287464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90127c-a753-4dd4-ac6e-e24627aad1e2 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:53:52.374404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e0ca0-7297-477b-8616-ff01fee1d9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:53:52.374996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e0ca0-7297-477b-8616-ff01fee1d9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:53:52.375268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e0ca0-7297-477b-8616-ff01fee1d9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:53:52.375529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e0ca0-7297-477b-8616-ff01fee1d9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:53:52.377150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-258e0ca0-7297-477b-8616-ff01fee1d9d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:53:52.385650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:53:52.491900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e0ca0-7297-477b-8616-ff01fee1d9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:53:52.493340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e0ca0-7297-477b-8616-ff01fee1d9d3 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:53:52.511947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 753/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:54:01.856548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=82 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:54:02.509545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=50 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:06.106138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:06.107014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:06.107014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:06.198239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:55:06.199445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:06.306774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 741/1494] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:55:06.314696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b8214-5997-46d6-a701-0af28daa7974 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:06.315320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b8214-5997-46d6-a701-0af28daa7974 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:06.315320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b8214-5997-46d6-a701-0af28daa7974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:06.393784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-cc3b8214-5997-46d6-a701-0af28daa7974 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:55:06.394893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-cc3b8214-5997-46d6-a701-0af28daa7974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:06.507366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 754/1495] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:55:06.512210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:06.513421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:06.525049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779a86-91f7-44ea-ac5f-a21a546f1477 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:06.591020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:06.627235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:06.627865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:06.628160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:06.628420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:06.629051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:55:06.629342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:06.630361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:06.630361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:55:06.630361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:55:06.631240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:06.643131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 742/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:55:06.651808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b8214-5997-46d6-a701-0af28daa7974 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:06.661678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b8214-5997-46d6-a701-0af28daa7974 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:06.727842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:06.763239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:06.763882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:06.764154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:06.764419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:06.765043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:06.766834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING py.warnings [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:06.766834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: warnings.warn(msg) Sep 15 12:55:06.766834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: Sep 15 12:55:06.768049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:06.840362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 755/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:55:06 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:55:06.845166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:06.846691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:06.884295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cd8c3-17f0-4d25-baa5-2750b6cb1464 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:06.994027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:06.994627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:06.994899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:06.995163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:06.995811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:06.996816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:06.996816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:55:06.996816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:55:06.998003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:07.062743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 743/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:55:06 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:55:07.067582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:07.069119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:07.131834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec9cd-4ffb-408f-8295-20739bb931e4 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:07.231926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:07.244521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:07.245148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:07.245481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:07.245753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:07.246372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:07.248076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING py.warnings [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:07.248076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: warnings.warn(msg) Sep 15 12:55:07.248076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: Sep 15 12:55:07.249099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:07.262120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 756/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:55:07.266700 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:07.268289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:07.279791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0441256-d53f-4b9e-94d2-77b8266f625e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:07.306024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:07.380075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1360cb0-9e74-4c9c-8053-4f33e1d95323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:07.380689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360cb0-9e74-4c9c-8053-4f33e1d95323 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:07.380963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360cb0-9e74-4c9c-8053-4f33e1d95323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:07.381230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1360cb0-9e74-4c9c-8053-4f33e1d95323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:07.381905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1360cb0-9e74-4c9c-8053-4f33e1d95323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:07.382986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-a1360cb0-9e74-4c9c-8053-4f33e1d95323 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:07.382986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:55:07.382986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:55:07.383903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1360cb0-9e74-4c9c-8053-4f33e1d95323 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:07.397554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 744/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:55:07.402583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:07.404722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:07.441867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d719e7-99d0-40ec-ab35-1d5f608d2b94 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:07.553789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f15d2-c3a4-4c86-9be2-8d1afa3d808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:07.554383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f15d2-c3a4-4c86-9be2-8d1afa3d808a admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:07.554659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f15d2-c3a4-4c86-9be2-8d1afa3d808a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:07.554926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f15d2-c3a4-4c86-9be2-8d1afa3d808a admin admin] PATH_INFO: `/v3/projects/33a6de5d2b9d4a1eaab6eed6ec5909eb/users/eb5a957b68594256891c96f3ff2dce7c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:07.580112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f15d2-c3a4-4c86-9be2-8d1afa3d808a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a6de5d2b9d4a1eaab6eed6ec5909eb, user_id=eb5a957b68594256891c96f3ff2dce7c, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:07.581338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING py.warnings [None req-8f4f15d2-c3a4-4c86-9be2-8d1afa3d808a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:07.581338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: warnings.warn(msg) Sep 15 12:55:07.581338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: Sep 15 12:55:07.583299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f15d2-c3a4-4c86-9be2-8d1afa3d808a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:07.610329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 757/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:55:07 2022] PUT /identity/v3/projects/33a6de5d2b9d4a1eaab6eed6ec5909eb/users/eb5a957b68594256891c96f3ff2dce7c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:55:07.623065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930140c3-e8d0-4cd8-9c96-072a7941636c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:07.623421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930140c3-e8d0-4cd8-9c96-072a7941636c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:07.623716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930140c3-e8d0-4cd8-9c96-072a7941636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:07.688239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-930140c3-e8d0-4cd8-9c96-072a7941636c None None] MFA Rules not processed for user `eb5a957b68594256891c96f3ff2dce7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:55:07.689464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-930140c3-e8d0-4cd8-9c96-072a7941636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:07.770314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 745/1502] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:55:07.786966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde6f71-1f85-46a5-9e10-00399008772a None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:07.787248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde6f71-1f85-46a5-9e10-00399008772a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:07.787511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde6f71-1f85-46a5-9e10-00399008772a None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:07.788932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 758/1503] 10.222.0.42 () {54 vars in 964 bytes} [Thu Sep 15 12:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:55:07.794059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443adef-1291-4e54-a8f6-bdeffcb9d74c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:07.794342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443adef-1291-4e54-a8f6-bdeffcb9d74c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:07.794603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443adef-1291-4e54-a8f6-bdeffcb9d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:07.828063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:07.876936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2443adef-1291-4e54-a8f6-bdeffcb9d74c None None] MFA Rules not processed for user `faee06d60a484eebb6a9fb31ce0878d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:55:07.878121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2443adef-1291-4e54-a8f6-bdeffcb9d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:07.957862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 746/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Thu Sep 15 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:55:07.973191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde6f71-1f85-46a5-9e10-00399008772a None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:07.975858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3cde6f71-1f85-46a5-9e10-00399008772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:08.031714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:08.089741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde6f71-1f85-46a5-9e10-00399008772a None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:08.174079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:08.174685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:08.174956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:08.175221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:08.176820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:08.276942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:08.278383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:08.281880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:08.296828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 759/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:55:08.342890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513249c-f3a8-4f25-a002-20955654d253 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:08.343347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513249c-f3a8-4f25-a002-20955654d253 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:08.343347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513249c-f3a8-4f25-a002-20955654d253 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:08.344644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 747/1506] 10.222.0.42 () {52 vars in 830 bytes} [Thu Sep 15 12:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:55:08.348642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:08.350194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:08.451489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab5f5c-4c3f-4a29-be6b-21188172b23b service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:08.546457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:08.547080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:08.547352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:08.547613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] PATH_INFO: `/v3/users/eb5a957b68594256891c96f3ff2dce7c` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:08.562650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5a957b68594256891c96f3ff2dce7c)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:08.563683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING py.warnings [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:08.563683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: warnings.warn(msg) Sep 15 12:55:08.563683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: Sep 15 12:55:08.565223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:08.575323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:08.634818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5a957b68594256891c96f3ff2dce7c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:08.645965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5a957b68594256891c96f3ff2dce7c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:08.661099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5a957b68594256891c96f3ff2dce7c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:08.661549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5a957b68594256891c96f3ff2dce7c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:08.685171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5a957b68594256891c96f3ff2dce7c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:08.690967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 760/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:55:08 2022] DELETE /identity/v3/users/eb5a957b68594256891c96f3ff2dce7c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:55:08.695550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:08.695865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:08.696132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:08.760006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:55:08.761219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:08.851507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:08.865228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 748/1508] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:55:08.879675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:08.881612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:08.989703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2a8e7-19a4-4430-b305-f43cf7301732 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:09.044936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:09.065730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc3dd9-ab7a-459a-8bdc-eae4a46d4d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:09.066338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc3dd9-ab7a-459a-8bdc-eae4a46d4d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:09.066612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc3dd9-ab7a-459a-8bdc-eae4a46d4d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:09.066869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc3dd9-ab7a-459a-8bdc-eae4a46d4d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:09.068487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fdbc3dd9-ab7a-459a-8bdc-eae4a46d4d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:09.180828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc3dd9-ab7a-459a-8bdc-eae4a46d4d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:09.182329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc3dd9-ab7a-459a-8bdc-eae4a46d4d6a service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:09.201582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 761/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:55:09.550772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:55:09.552065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:55:09.566239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ed8c-7f04-4370-93a6-d7de31b608fc None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:55:09.674899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:55:09.675722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:55:09.676022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:55:09.676295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] PATH_INFO: `/v3/projects/33a6de5d2b9d4a1eaab6eed6ec5909eb` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:55:09.688319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a6de5d2b9d4a1eaab6eed6ec5909eb)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:55:09.689375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:55:09.689375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:55:09.689375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:55:09.691020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:55:09.752260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a6de5d2b9d4a1eaab6eed6ec5909eb', 'request_id': 'req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:09.762906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a6de5d2b9d4a1eaab6eed6ec5909eb', 'request_id': 'req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:09.771882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a6de5d2b9d4a1eaab6eed6ec5909eb', 'request_id': 'req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:09.803968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] The token cache is being invalidate because project 33a6de5d2b9d4a1eaab6eed6ec5909eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:55:09.804234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:09.804681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fc9847b3-fcc7-4fd8-a349-a2ffd464002b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:55:09.806109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 749/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:55:09 2022] DELETE /identity/v3/projects/33a6de5d2b9d4a1eaab6eed6ec5909eb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:55:19.199173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=62 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:55:19.801738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:56:38.503465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7999-5924-4061-af34-fa2d523cb610 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:38.504125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7999-5924-4061-af34-fa2d523cb610 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:38.504125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f7999-5924-4061-af34-fa2d523cb610 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:38.505379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:56:38.510603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebc427-279f-47f3-8058-1666021b41d1 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:38.511163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebc427-279f-47f3-8058-1666021b41d1 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:38.511163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebc427-279f-47f3-8058-1666021b41d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:38.610084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f5ebc427-279f-47f3-8058-1666021b41d1 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:56:38.611508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f5ebc427-279f-47f3-8058-1666021b41d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:38.741538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:56:38.901836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f7999-5924-4061-af34-fa2d523cb610 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:56:38.905908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8c7f7999-5924-4061-af34-fa2d523cb610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:39.035619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f7999-5924-4061-af34-fa2d523cb610 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:56:39.045575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073586c-d53f-4dd1-b884-52fb5e21eeb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:56:39.046187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073586c-d53f-4dd1-b884-52fb5e21eeb5 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:39.046456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073586c-d53f-4dd1-b884-52fb5e21eeb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:39.046718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073586c-d53f-4dd1-b884-52fb5e21eeb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:39.055854 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073586c-d53f-4dd1-b884-52fb5e21eeb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:56:39.057436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073586c-d53f-4dd1-b884-52fb5e21eeb5 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:56:39.067091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 763/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:56:40.177461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec6fc-dc39-443f-8038-41417d55d147 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:40.178307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec6fc-dc39-443f-8038-41417d55d147 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:40.178307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec6fc-dc39-443f-8038-41417d55d147 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:40.180276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:56:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:56:40.186968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9daa-062c-483d-be89-b4452d55d567 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:40.187454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9daa-062c-483d-be89-b4452d55d567 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:40.187548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d9daa-062c-483d-be89-b4452d55d567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:40.209230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-ba6d9daa-062c-483d-be89-b4452d55d567 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:56:40.210444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ba6d9daa-062c-483d-be89-b4452d55d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:40.219418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:56:40.371439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec6fc-dc39-443f-8038-41417d55d147 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:56:40.386574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aec6fc-dc39-443f-8038-41417d55d147 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:56:40.392356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aeeb6-3ef6-4a7d-846f-2b396d85af10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:56:40.393031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aeeb6-3ef6-4a7d-846f-2b396d85af10 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:40.393309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aeeb6-3ef6-4a7d-846f-2b396d85af10 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:40.393579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aeeb6-3ef6-4a7d-846f-2b396d85af10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:40.403016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aeeb6-3ef6-4a7d-846f-2b396d85af10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:56:40.404632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aeeb6-3ef6-4a7d-846f-2b396d85af10 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:56:40.414118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 752/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:56:40.630308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf954-0dd5-48a8-a9ed-10f036af2588 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:40.630555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf954-0dd5-48a8-a9ed-10f036af2588 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:40.630840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf954-0dd5-48a8-a9ed-10f036af2588 None None] PATH_INFO: `/v3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:40.632209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 765/1517] 10.222.0.59 () {54 vars in 925 bytes} [Thu Sep 15 12:56:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:56:40.639589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bb12-6415-469d-b394-3b8632139af8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:40.639959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bb12-6415-469d-b394-3b8632139af8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:40.640258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bb12-6415-469d-b394-3b8632139af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:40.709915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-13d0bb12-6415-469d-b394-3b8632139af8 None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:56:40.711033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-13d0bb12-6415-469d-b394-3b8632139af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:40.729316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:56:40.791148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 753/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Sep 15 12:56:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:56:44.420591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4d217-65a7-4128-8d55-12ce3154cd36 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:44.421211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4d217-65a7-4128-8d55-12ce3154cd36 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:44.421211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4d217-65a7-4128-8d55-12ce3154cd36 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:44.423055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 766/1519] 10.222.0.42 () {54 vars in 961 bytes} [Thu Sep 15 12:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:56:44.430281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a416f4-7059-49e6-ab72-8f03e96df7f3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:44.430807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a416f4-7059-49e6-ab72-8f03e96df7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:44.430807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a416f4-7059-49e6-ab72-8f03e96df7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:44.452450 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-44a416f4-7059-49e6-ab72-8f03e96df7f3 None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:56:44.453658 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-44a416f4-7059-49e6-ab72-8f03e96df7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:44.462810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 754/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Thu Sep 15 12:56:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:56:44.471115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4d217-65a7-4128-8d55-12ce3154cd36 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:56:44.492866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4d217-65a7-4128-8d55-12ce3154cd36 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:56:44.501530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc2659-5f8a-4e08-bcb0-fc087c3be344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:56:44.502209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2659-5f8a-4e08-bcb0-fc087c3be344 service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:44.502559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2659-5f8a-4e08-bcb0-fc087c3be344 service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:44.502995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2659-5f8a-4e08-bcb0-fc087c3be344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:44.516216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc2659-5f8a-4e08-bcb0-fc087c3be344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:56:44.517804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc2659-5f8a-4e08-bcb0-fc087c3be344 service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:56:44.527985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 767/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:56:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:56:51.904622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebcf04-8a30-48d3-b739-49cfc80efc1c None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:51.905705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebcf04-8a30-48d3-b739-49cfc80efc1c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:51.905705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebcf04-8a30-48d3-b739-49cfc80efc1c None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:51.907673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:56:51.916342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8ee14-49b1-4d40-b785-4396c9658d17 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:51.916844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8ee14-49b1-4d40-b785-4396c9658d17 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:51.916844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8ee14-49b1-4d40-b785-4396c9658d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:51.941625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6cd8ee14-49b1-4d40-b785-4396c9658d17 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:56:51.942813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6cd8ee14-49b1-4d40-b785-4396c9658d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:51.952430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:56:52.114935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebcf04-8a30-48d3-b739-49cfc80efc1c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:56:52.129543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebcf04-8a30-48d3-b739-49cfc80efc1c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:56:52.136540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927f51c-d2db-41e6-ae9a-c2cd59b8739c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:56:52.137170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f51c-d2db-41e6-ae9a-c2cd59b8739c service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:52.137440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f51c-d2db-41e6-ae9a-c2cd59b8739c service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:52.137698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f51c-d2db-41e6-ae9a-c2cd59b8739c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:52.146406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927f51c-d2db-41e6-ae9a-c2cd59b8739c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:56:52.148029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927f51c-d2db-41e6-ae9a-c2cd59b8739c service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:56:52.157722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 756/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:56:53.229144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df34e2-62ae-4ff0-b102-64bc67293c56 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:53.229736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df34e2-62ae-4ff0-b102-64bc67293c56 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:53.229736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df34e2-62ae-4ff0-b102-64bc67293c56 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:53.230958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:56:53.241762 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956940d8-92c4-4751-8dd3-96fc22304e95 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:53.242493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956940d8-92c4-4751-8dd3-96fc22304e95 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:53.242638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956940d8-92c4-4751-8dd3-96fc22304e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:53.267640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-956940d8-92c4-4751-8dd3-96fc22304e95 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:56:53.268882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-956940d8-92c4-4751-8dd3-96fc22304e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:53.280875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:56:53.439870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df34e2-62ae-4ff0-b102-64bc67293c56 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:56:53.460650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df34e2-62ae-4ff0-b102-64bc67293c56 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:56:53.467297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5be48d-e4c9-44f6-a830-66f4fbebdfe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:56:53.467927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5be48d-e4c9-44f6-a830-66f4fbebdfe6 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:53.468197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5be48d-e4c9-44f6-a830-66f4fbebdfe6 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:53.468454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5be48d-e4c9-44f6-a830-66f4fbebdfe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:53.477535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5be48d-e4c9-44f6-a830-66f4fbebdfe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:56:53.479121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5be48d-e4c9-44f6-a830-66f4fbebdfe6 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:56:53.488997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 770/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:56:57.380894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a825-2fa1-4ccd-9f0c-633b8db34aa3 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:57.381475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a825-2fa1-4ccd-9f0c-633b8db34aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:57.381475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5a825-2fa1-4ccd-9f0c-633b8db34aa3 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:57.382805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:56:57.389174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf2afc-e7e1-4657-8eca-3f98d85428ab None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:57.389920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf2afc-e7e1-4657-8eca-3f98d85428ab None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:57.390075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf2afc-e7e1-4657-8eca-3f98d85428ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:57.414191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-ddaf2afc-e7e1-4657-8eca-3f98d85428ab None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:56:57.415380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ddaf2afc-e7e1-4657-8eca-3f98d85428ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:57.425253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:56:57.712645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a825-2fa1-4ccd-9f0c-633b8db34aa3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:56:57.715850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6ba5a825-2fa1-4ccd-9f0c-633b8db34aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:56:57.810304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5a825-2fa1-4ccd-9f0c-633b8db34aa3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:56:57.814705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88141db9-4b27-4806-9006-187cfb0507dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:56:57.815326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141db9-4b27-4806-9006-187cfb0507dc service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:57.815595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141db9-4b27-4806-9006-187cfb0507dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:57.815897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88141db9-4b27-4806-9006-187cfb0507dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:57.826641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88141db9-4b27-4806-9006-187cfb0507dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:56:57.828118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88141db9-4b27-4806-9006-187cfb0507dc service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:56:57.838095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 759/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:56:59.981434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddc05a-017d-4290-a96a-cad06ea26624 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:59.982374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddc05a-017d-4290-a96a-cad06ea26624 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:59.982374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddc05a-017d-4290-a96a-cad06ea26624 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:56:59.984499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:56:59.990109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc962b-60a8-4082-9910-4a8c56e46da6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:56:59.990593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc962b-60a8-4082-9910-4a8c56e46da6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:56:59.990765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc962b-60a8-4082-9910-4a8c56e46da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:00.011986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3fcc962b-60a8-4082-9910-4a8c56e46da6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:57:00.013168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3fcc962b-60a8-4082-9910-4a8c56e46da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:57:00.021435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:57:00.318255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddc05a-017d-4290-a96a-cad06ea26624 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:57:00.327836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=75 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:57:00.337081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddc05a-017d-4290-a96a-cad06ea26624 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:57:00.341103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fbc8c-57a4-4195-becf-3d7de06dea22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:57:00.341727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbc8c-57a4-4195-becf-3d7de06dea22 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:57:00.341995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbc8c-57a4-4195-becf-3d7de06dea22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:57:00.342256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fbc8c-57a4-4195-becf-3d7de06dea22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:00.351998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fbc8c-57a4-4195-becf-3d7de06dea22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:57:00.353467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fbc8c-57a4-4195-becf-3d7de06dea22 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:57:00.362828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 773/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:57:03.952065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7bad-f260-44a9-83b2-7c586606c7da None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:57:03.952675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7bad-f260-44a9-83b2-7c586606c7da None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:57:03.952675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7bad-f260-44a9-83b2-7c586606c7da None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:03.954100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:57:03.960687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92917728-7da3-4cbe-90c3-912b022fbc7f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:57:03.961383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92917728-7da3-4cbe-90c3-912b022fbc7f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:57:03.961537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92917728-7da3-4cbe-90c3-912b022fbc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:03.994469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-92917728-7da3-4cbe-90c3-912b022fbc7f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:57:03.995712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-92917728-7da3-4cbe-90c3-912b022fbc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:57:04.005097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:57:04.313107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7bad-f260-44a9-83b2-7c586606c7da None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:57:04.316362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4e7c7bad-f260-44a9-83b2-7c586606c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:57:04.386521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:57:04.402283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7bad-f260-44a9-83b2-7c586606c7da None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:57:04.406693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298f47b-3bdc-4210-b6d1-38b780848aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:57:04.407649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f47b-3bdc-4210-b6d1-38b780848aca service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:57:04.408142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f47b-3bdc-4210-b6d1-38b780848aca service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:57:04.408566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f47b-3bdc-4210-b6d1-38b780848aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:04.422039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298f47b-3bdc-4210-b6d1-38b780848aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:57:04.424252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298f47b-3bdc-4210-b6d1-38b780848aca service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:57:04.438726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 762/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:57:06.590044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f764-0b87-45f2-88be-d652b53fc4a0 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:57:06.590641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f764-0b87-45f2-88be-d652b53fc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:57:06.590641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190f764-0b87-45f2-88be-d652b53fc4a0 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:06.591975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:57:06.598429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a7b70-ce46-47de-aaee-9b5551464bb3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:57:06.599528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a7b70-ce46-47de-aaee-9b5551464bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:57:06.599617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a7b70-ce46-47de-aaee-9b5551464bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:06.619987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-206a7b70-ce46-47de-aaee-9b5551464bb3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:57:06.621176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-206a7b70-ce46-47de-aaee-9b5551464bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:57:06.629826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:57:06.945003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f764-0b87-45f2-88be-d652b53fc4a0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:57:06.947921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4190f764-0b87-45f2-88be-d652b53fc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:57:06.967168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190f764-0b87-45f2-88be-d652b53fc4a0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:57:06.973449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723f175-b40a-400f-939b-9a516b633d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:57:06.975375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f175-b40a-400f-939b-9a516b633d4e service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:57:06.975681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f175-b40a-400f-939b-9a516b633d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:57:06.976007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f175-b40a-400f-939b-9a516b633d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:57:06.989248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723f175-b40a-400f-939b-9a516b633d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:57:06.991367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723f175-b40a-400f-939b-9a516b633d4e service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:57:07.001345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 776/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:57:16.615011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=11 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:57:16.997009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=14 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:33.573364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c6bd-8cb9-4c3f-a4f6-93e3ef67de8f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.574659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c6bd-8cb9-4c3f-a4f6-93e3ef67de8f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.575334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c6bd-8cb9-4c3f-a4f6-93e3ef67de8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.616278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086e503-d435-4c49-a3ae-96aff98b81eb None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.619448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086e503-d435-4c49-a3ae-96aff98b81eb None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.619448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086e503-d435-4c49-a3ae-96aff98b81eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.626862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f078c6bd-8cb9-4c3f-a4f6-93e3ef67de8f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.628099 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f078c6bd-8cb9-4c3f-a4f6-93e3ef67de8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.654683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 764/1540] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.656055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a64daf-b9d6-4fd5-8b7f-6b2f6f6c7cc3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.656333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a64daf-b9d6-4fd5-8b7f-6b2f6f6c7cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.656595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a64daf-b9d6-4fd5-8b7f-6b2f6f6c7cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.656964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a086e503-d435-4c49-a3ae-96aff98b81eb None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.658171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a086e503-d435-4c49-a3ae-96aff98b81eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.674959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 777/1541] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.678631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5ead-1eca-4708-9779-364a10f96194 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.678933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5ead-1eca-4708-9779-364a10f96194 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.679176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5ead-1eca-4708-9779-364a10f96194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.694717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-36a64daf-b9d6-4fd5-8b7f-6b2f6f6c7cc3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.696378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-36a64daf-b9d6-4fd5-8b7f-6b2f6f6c7cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.712781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8bae5ead-1eca-4708-9779-364a10f96194 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.713629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 765/1542] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.715152 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a1f35-7e5c-444b-b839-563a12bc4a4b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.715729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a1f35-7e5c-444b-b839-563a12bc4a4b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.716277 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a1f35-7e5c-444b-b839-563a12bc4a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.720266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8bae5ead-1eca-4708-9779-364a10f96194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.736359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 778/1543] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.737811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05a760-f4ec-4768-9a32-0efbc2748366 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.738097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05a760-f4ec-4768-9a32-0efbc2748366 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.738362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05a760-f4ec-4768-9a32-0efbc2748366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.752326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-420a1f35-7e5c-444b-b839-563a12bc4a4b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.753951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-420a1f35-7e5c-444b-b839-563a12bc4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.769775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 766/1544] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.772392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a1f35-7e5c-444b-b839-563a12bc4a4b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:33.777285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4d05a760-f4ec-4768-9a32-0efbc2748366 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.779280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4d05a760-f4ec-4768-9a32-0efbc2748366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.789187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a1f35-7e5c-444b-b839-563a12bc4a4b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:33.793836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 779/1545] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.799323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2670d-fb0e-4fe9-9436-a5f29591ea5a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.799667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2670d-fb0e-4fe9-9436-a5f29591ea5a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.799912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2670d-fb0e-4fe9-9436-a5f29591ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.807306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:33.808070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.808359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.808633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.809412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:33.809717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:33.811493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:33.824012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6ed2670d-fb0e-4fe9-9436-a5f29591ea5a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.826623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 767/1546] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:33.826623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:33.827536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6ed2670d-fb0e-4fe9-9436-a5f29591ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.837746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163bcd1-66f0-4b8c-88c1-2a836e70b29f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:33.839127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 780/1547] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.841053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968765e-2432-4c45-b216-54f8a0c4ae89 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.841559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968765e-2432-4c45-b216-54f8a0c4ae89 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.842126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968765e-2432-4c45-b216-54f8a0c4ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.842593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf17f9a-cfdc-497f-a1ac-10f4e14e9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:33.843205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17f9a-cfdc-497f-a1ac-10f4e14e9709 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.843488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17f9a-cfdc-497f-a1ac-10f4e14e9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.843795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf17f9a-cfdc-497f-a1ac-10f4e14e9709 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.844432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17f9a-cfdc-497f-a1ac-10f4e14e9709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:33.844731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17f9a-cfdc-497f-a1ac-10f4e14e9709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:33.846749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf17f9a-cfdc-497f-a1ac-10f4e14e9709 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:33.861047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 768/1548] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:33.865374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dac3b-b924-4e61-ab73-b3527695780b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.865374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dac3b-b924-4e61-ab73-b3527695780b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.865374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dac3b-b924-4e61-ab73-b3527695780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.872948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a968765e-2432-4c45-b216-54f8a0c4ae89 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.874473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a968765e-2432-4c45-b216-54f8a0c4ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.884029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 781/1549] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.884293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-670dac3b-b924-4e61-ab73-b3527695780b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.885291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968765e-2432-4c45-b216-54f8a0c4ae89 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:33.885491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-670dac3b-b924-4e61-ab73-b3527695780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.894228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 769/1550] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:33.895021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dac3b-b924-4e61-ab73-b3527695780b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:33.897019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968765e-2432-4c45-b216-54f8a0c4ae89 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:33.901917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:33.902857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.903413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.903988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.904837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:33.905267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dac3b-b924-4e61-ab73-b3527695780b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:33.905524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:33.906834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING py.warnings [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:58:33.906834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: warnings.warn(msg) Sep 15 12:58:33.906834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: Sep 15 12:58:33.908479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b2508-feca-48a8-ad50-8372d8d7a8fc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:33.910138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:33.910745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.911021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.911288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.912025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:33.913078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:58:33.913078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:58:33.913078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:58:33.914259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:33.924523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 782/1551] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:33.926415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57febd27-4044-4b90-9e79-0dbd24dc235a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:33.927005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57febd27-4044-4b90-9e79-0dbd24dc235a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:33.927549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57febd27-4044-4b90-9e79-0dbd24dc235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:33.951814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-57febd27-4044-4b90-9e79-0dbd24dc235a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:33.953063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-57febd27-4044-4b90-9e79-0dbd24dc235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:33.956804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 770/1552] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:33.957448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.017579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 783/1553] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:34.018843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195df2d-7a18-4dac-ac14-a5aaa11a4cb2 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.019126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195df2d-7a18-4dac-ac14-a5aaa11a4cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.019391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195df2d-7a18-4dac-ac14-a5aaa11a4cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.025692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252c506-6995-4695-abf3-109d5e0387a1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.030531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5e63-ff66-4b01-9388-c86856b6f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.031140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5e63-ff66-4b01-9388-c86856b6f157 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.031414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5e63-ff66-4b01-9388-c86856b6f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.031677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5e63-ff66-4b01-9388-c86856b6f157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.032342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5e63-ff66-4b01-9388-c86856b6f157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.034240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5e63-ff66-4b01-9388-c86856b6f157 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.038586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7195df2d-7a18-4dac-ac14-a5aaa11a4cb2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:34.039795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7195df2d-7a18-4dac-ac14-a5aaa11a4cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:34.048074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 784/1554] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:34.049276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6fe5a-43d4-4b04-b904-e10e0d318770 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.049552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6fe5a-43d4-4b04-b904-e10e0d318770 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.049818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6fe5a-43d4-4b04-b904-e10e0d318770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.070053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-23b6fe5a-43d4-4b04-b904-e10e0d318770 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:34.070299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 771/1555] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:33 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.071236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-23b6fe5a-43d4-4b04-b904-e10e0d318770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:34.071688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a134d47-fefc-4eb9-9d60-5bfab04aa061 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.072000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a134d47-fefc-4eb9-9d60-5bfab04aa061 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.072272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a134d47-fefc-4eb9-9d60-5bfab04aa061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.092210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2a134d47-fefc-4eb9-9d60-5bfab04aa061 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:34.093422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2a134d47-fefc-4eb9-9d60-5bfab04aa061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:34.132891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 785/1556] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:34.133783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6fe5a-43d4-4b04-b904-e10e0d318770 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.142980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6fe5a-43d4-4b04-b904-e10e0d318770 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.147637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f907-4da0-4f42-84e7-31e6d8c185bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.148260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f907-4da0-4f42-84e7-31e6d8c185bd admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.148539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f907-4da0-4f42-84e7-31e6d8c185bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.148799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f907-4da0-4f42-84e7-31e6d8c185bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.149414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95f907-4da0-4f42-84e7-31e6d8c185bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.151483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95f907-4da0-4f42-84e7-31e6d8c185bd admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.156273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 772/1557] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:34.157252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a134d47-fefc-4eb9-9d60-5bfab04aa061 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.161920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:34.167561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a134d47-fefc-4eb9-9d60-5bfab04aa061 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.173625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.174272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.174598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.174816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.175995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.178614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.181090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 786/1558] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.182521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb775-4575-43d9-bc8c-1cde22964433 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.182799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb775-4575-43d9-bc8c-1cde22964433 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.183061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb775-4575-43d9-bc8c-1cde22964433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.202429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 773/1559] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.203157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.206333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-debfb775-4575-43d9-bc8c-1cde22964433 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:34.207601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-debfb775-4575-43d9-bc8c-1cde22964433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:34.216178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72040c-7340-413c-9c84-502f3190c20c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.228800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:34.268081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 787/1560] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:34.269679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd984f-c221-46e0-8c4f-3847bc5df1db None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.269961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd984f-c221-46e0-8c4f-3847bc5df1db None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.270225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd984f-c221-46e0-8c4f-3847bc5df1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.279715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.280339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.280619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.280893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.281543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:34.281846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.283493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.290724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3abd984f-c221-46e0-8c4f-3847bc5df1db None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:34.291532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3abd984f-c221-46e0-8c4f-3847bc5df1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:34.295400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 774/1561] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:34.296219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.305842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 788/1562] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:34.306644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd984f-c221-46e0-8c4f-3847bc5df1db None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.314864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef496cd-9e1c-46fe-a597-21a2dc70ac9a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.316405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd984f-c221-46e0-8c4f-3847bc5df1db None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.319913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.320519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.320797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.321062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.321261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.321687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.321837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.322108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.322366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.322999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:34.323291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.323627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.325048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.337666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 789/1563] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:34.338638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.349373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 775/1564] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.349373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.349659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777238b-ef4b-4cd9-93c7-64ee479036a3 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.354186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.354775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.355052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.355315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.356103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:34.356543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.358300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.359437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46a65-c7ac-46d0-9571-787501877725 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.364035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c6080-7ccc-4637-8c4d-22b03f305ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.364625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6080-7ccc-4637-8c4d-22b03f305ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.364900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6080-7ccc-4637-8c4d-22b03f305ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.365166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c6080-7ccc-4637-8c4d-22b03f305ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.365782 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c6080-7ccc-4637-8c4d-22b03f305ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.367737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c6080-7ccc-4637-8c4d-22b03f305ff7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.370595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 790/1565] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:34.371523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.382970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc7109-ef3d-4caf-9e00-f6e1dee13f6f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.388350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.388971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.389223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.389481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.390107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.394423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 776/1566] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.394562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.394675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80152d-bb1d-44df-9875-9747f6827e18 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.394675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80152d-bb1d-44df-9875-9747f6827e18 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.394675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80152d-bb1d-44df-9875-9747f6827e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.403000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 791/1567] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:34.403156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.414631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8f80152d-bb1d-44df-9875-9747f6827e18 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:34.415184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd85e54-f8fe-4cb1-b2a3-62020a26cd7f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.415861 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8f80152d-bb1d-44df-9875-9747f6827e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:34.419590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.420221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.420492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.420749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.421385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.423267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.424892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 777/1568] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:34.426199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80152d-bb1d-44df-9875-9747f6827e18 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.436347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80152d-bb1d-44df-9875-9747f6827e18 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.441050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.441805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.441915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.442161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.442817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:34.443109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.444732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.457264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 778/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:34.458404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.460161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 792/1570] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.460971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.472610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406c33b-7e89-44b6-8c58-7220a596a19e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.523798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90201a93-10a0-4e4b-9eed-0f14a05b4f75 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.528743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.529361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.529668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.529933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.530608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.532233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.534817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.535431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.535736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.536124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.536764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.538660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.543529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 793/1571] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:34.544093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.554559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b1fb7-f149-4059-8ad4-ea59ba080a30 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.560905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.561715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.561984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.562213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.562903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.565016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.569962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 779/1572] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.570824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.580486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:34.595467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 794/1573] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.597293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.635294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e721ba-b8e3-4b29-9b59-83d4afb08b54 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.636121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:34.660518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af40a5-d825-4bbc-a7f2-3cbd4e6ad213 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.665148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.665762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.666038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.666308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.666943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.668707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.678765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 795/1574] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:34.679614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.689641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bd45a-17dd-4b4f-afbe-fbba7acc563e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.694323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.694928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.695189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.695456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.696147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:34.696443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.697488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.698168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.698310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.698680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.699014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.699785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.701550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.710408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 796/1575] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:34.711124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.714847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 780/1576] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:34.714847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.728371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002c465-33de-4871-8de0-37bf6c1c0368 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.728654 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a1662-06d4-4133-9d1c-451907a97ad1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.733271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.733844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.734123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.734245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.734399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.734821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.735009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.735115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.735351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.736014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.736932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.737898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.763440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 781/1577] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.763440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.766145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 797/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.766994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.773318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76f66a-1c04-436d-b203-fbc852b8aad2 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.832093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ddf5-9fad-40cf-852b-86ce4e763976 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.837715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.838891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.839014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.839228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.839920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.840940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.841582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.841692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING py.warnings [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:58:34.841692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: warnings.warn(msg) Sep 15 12:58:34.841692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: Sep 15 12:58:34.841948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.842107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.842748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.842851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.844372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.855116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 782/1579] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:34.856084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.865905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc29d1-607e-4b02-aaaa-2bd3d249587e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.867172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 798/1580] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.867879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.870991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.871717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.872028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.872292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.872916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.874827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.877702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef852663-7b0d-42a7-a4b7-5723d1154f8f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.882767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.883419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.883716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.883988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] PATH_INFO: `/v3/projects/c2a6fab289e7446dbcd3ccc52b961a9f/users/94e1cd16edbb4795b4dfb690910488ec/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.898667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 783/1581] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/users => generated 282 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:34.900131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a6fab289e7446dbcd3ccc52b961a9f, user_id=94e1cd16edbb4795b4dfb690910488ec, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.900751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.902922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.911650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aaccd-a896-4acf-b6c2-e7a94b26da09 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.931409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 799/1582] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:34 2022] PUT /identity/v3/projects/c2a6fab289e7446dbcd3ccc52b961a9f/users/94e1cd16edbb4795b4dfb690910488ec/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:34.931409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.933030 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:34.974463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.975130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.975404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.975679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.976345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.977990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.981383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150ae85-5165-453a-af08-e1a0f6b28727 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:34.986337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:34.987009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:34.987398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:34.987677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:34.991671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 784/1583] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:34.991857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:34.991971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:34.992057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:34.996077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:35.001252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bc58f-fe40-4e58-9de3-092b29aca4b4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.006065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.006672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.006992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.007255 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.008059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.010081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.020343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 785/1584] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.024310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 800/1585] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:34 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:35.024456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.024557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.033806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987b137-257b-45c9-bcca-dce33d45e8a7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.089471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881c62-b6a9-4c47-bf82-210888a4f00e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.091648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.092279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.092559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.092822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.093443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.094853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.095334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.095544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.095820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.096089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] PATH_INFO: `/v3/projects/a2ee68b74ab04bbcb9945e6f89e4152e/users/1d2b0118b29b4764bd270bdcd28c363a/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.111614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ee68b74ab04bbcb9945e6f89e4152e, user_id=1d2b0118b29b4764bd270bdcd28c363a, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.114339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.118305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 786/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:35.119366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.130771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed960648-06c7-49a7-be20-aabce7328937 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.131525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 801/1587] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:35 2022] PUT /identity/v3/projects/a2ee68b74ab04bbcb9945e6f89e4152e/users/1d2b0118b29b4764bd270bdcd28c363a/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:35.132746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.192783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4026-45e1-4bfa-984d-e48f630d0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.193440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4026-45e1-4bfa-984d-e48f630d0a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.193716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4026-45e1-4bfa-984d-e48f630d0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.193985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4026-45e1-4bfa-984d-e48f630d0a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.194616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4026-45e1-4bfa-984d-e48f630d0a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.196244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4026-45e1-4bfa-984d-e48f630d0a3b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.198415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d23798-0513-40cb-9fbb-cda8dc46c1b4 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.203074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.203687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.203986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.204249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.204936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.206165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 787/1588] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.206540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.207358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dd678-86a3-498a-a7aa-30753615b165 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.207781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dd678-86a3-498a-a7aa-30753615b165 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.208053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dd678-86a3-498a-a7aa-30753615b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.218756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 802/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.219422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.231217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776789d-9590-4dc0-973f-34dbff30fe6a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.236712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.237369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.237618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.237822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-fe8dd678-86a3-498a-a7aa-30753615b165 None None] MFA Rules not processed for user `94e1cd16edbb4795b4dfb690910488ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:35.237947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] PATH_INFO: `/v3/projects/edf77dc928684844b56bde0d546e5db5/users/05636960e9eb4dccbf9784871f79b774/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.239043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-fe8dd678-86a3-498a-a7aa-30753615b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:35.251024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:35.255020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf77dc928684844b56bde0d546e5db5, user_id=05636960e9eb4dccbf9784871f79b774, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.257707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.272613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 803/1590] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:35 2022] PUT /identity/v3/projects/edf77dc928684844b56bde0d546e5db5/users/05636960e9eb4dccbf9784871f79b774/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:35.273633 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.310878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 788/1591] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:35.311733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dd678-86a3-498a-a7aa-30753615b165 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.322092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:35.322952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dd678-86a3-498a-a7aa-30753615b165 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.342301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7513d-32fe-4d75-8e73-40585864ecc5 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.347523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.348169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.348444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.348712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.349382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.350998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.361025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 804/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.362043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.372005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dd684-af4b-4b1e-b2ad-1bd8b3bce9bf admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.376609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b9162-3523-49e1-b6eb-1d60e532598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.377186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b9162-3523-49e1-b6eb-1d60e532598b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.377506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b9162-3523-49e1-b6eb-1d60e532598b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.377777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b9162-3523-49e1-b6eb-1d60e532598b admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.378393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b9162-3523-49e1-b6eb-1d60e532598b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.379981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b9162-3523-49e1-b6eb-1d60e532598b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.380108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.380664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.380946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.381220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.381856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.383784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.389987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 805/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.391307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2393-7120-4ce3-9803-6fa5a82b6de0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.391582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2393-7120-4ce3-9803-6fa5a82b6de0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.391867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2393-7120-4ce3-9803-6fa5a82b6de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.412870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 789/1594] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:35.412870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.414173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-266b2393-7120-4ce3-9803-6fa5a82b6de0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:35.415352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-266b2393-7120-4ce3-9803-6fa5a82b6de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:35.422731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13552c-ebcd-4d5b-a87c-0fe81bb5cfdd admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.422880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 806/1595] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:35.423552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b2393-7120-4ce3-9803-6fa5a82b6de0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.427491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24aff06-4b02-4952-ae58-da1e557107df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.428024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aff06-4b02-4952-ae58-da1e557107df admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.428306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aff06-4b02-4952-ae58-da1e557107df admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.428581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24aff06-4b02-4952-ae58-da1e557107df admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.429487 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aff06-4b02-4952-ae58-da1e557107df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.430831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24aff06-4b02-4952-ae58-da1e557107df admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.432860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b2393-7120-4ce3-9803-6fa5a82b6de0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.438491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.439106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.439379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.439643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.440312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.441940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.445383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 790/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.445383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e4e7a-8b74-4d1b-a65e-e7f0e1985a6a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.445383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e4e7a-8b74-4d1b-a65e-e7f0e1985a6a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.445383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e4e7a-8b74-4d1b-a65e-e7f0e1985a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.455891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 807/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.455891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.463435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2107e-a5a4-4829-846c-3344327aff94 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.466774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b33e4e7a-8b74-4d1b-a65e-e7f0e1985a6a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:35.468019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b33e4e7a-8b74-4d1b-a65e-e7f0e1985a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:35.469067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.469764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.470040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.470319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.470978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.473235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.475994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 791/1598] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:35.479952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e4e7a-8b74-4d1b-a65e-e7f0e1985a6a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.490284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e4e7a-8b74-4d1b-a65e-e7f0e1985a6a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.495171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.495980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.496256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.496971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] PATH_INFO: `/v3/projects/6a8da0bef4a14d569721ae51684cebac/users/02d95a026009485ab5b847893c3b003b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.504517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 808/1599] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:35.505355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.513345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8da0bef4a14d569721ae51684cebac, user_id=02d95a026009485ab5b847893c3b003b, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.514405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:58:35.514405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:58:35.514405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:58:35.516395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.535921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 792/1600] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:35 2022] PUT /identity/v3/projects/6a8da0bef4a14d569721ae51684cebac/users/02d95a026009485ab5b847893c3b003b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:35.540645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.570707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca0f5a-88ef-474e-9221-71bbaef6e563 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.609493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf803-275d-45a0-a862-fcf73e42ade2 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.614315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.615043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.615391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.615663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.616321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.617988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.620125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:35.628465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.629097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.629525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.629645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 793/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.629848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.630358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.630501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.632140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.646042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 809/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.646042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.653983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22214a0b-0995-4529-a135-a2c76da3ad3e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.658783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.659538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.659864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.660132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] PATH_INFO: `/v3/projects/00e2d054379e488aa192bf655396fe62/users/cb0d882b2ac745399a6d1e524c464676/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.675613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e2d054379e488aa192bf655396fe62, user_id=cb0d882b2ac745399a6d1e524c464676, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.678286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.693138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602c12-b444-4722-8136-28d778253788 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.693921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 810/1603] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:35 2022] PUT /identity/v3/projects/00e2d054379e488aa192bf655396fe62/users/cb0d882b2ac745399a6d1e524c464676/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:35.694644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.705857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:35.746300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.746947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.747224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.747548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.763517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e3dde-6e58-495e-8310-b67ffb760209 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.768225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.768913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.769186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.769480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] PATH_INFO: `/v3/projects/b9b5988412cc43c5b41f41222d314516/users/8d970010dbea4075952b01f285c66238/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.785743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b5988412cc43c5b41f41222d314516, user_id=8d970010dbea4075952b01f285c66238, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.788742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.802991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 811/1604] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:35 2022] PUT /identity/v3/projects/b9b5988412cc43c5b41f41222d314516/users/8d970010dbea4075952b01f285c66238/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:35.804423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.808588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.810955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.821488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 794/1605] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:35.822274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.832217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40544-5ffd-48a8-afca-a69e6e0a3895 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.866531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a777f-ae1b-40f5-8e67-e9a89e33a47c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.872140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.872920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.873194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.873461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.897376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289dbda-4bee-45b5-a761-6d302682420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.898165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dbda-4bee-45b5-a761-6d302682420f admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.898513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dbda-4bee-45b5-a761-6d302682420f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.898913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289dbda-4bee-45b5-a761-6d302682420f admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.899637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289dbda-4bee-45b5-a761-6d302682420f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.901627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289dbda-4bee-45b5-a761-6d302682420f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.912921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:35.934730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 795/1606] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:35.934730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0593-0734-4b33-9dfd-89d852e96032 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.934730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0593-0734-4b33-9dfd-89d852e96032 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.934730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d0593-0734-4b33-9dfd-89d852e96032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.952258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.953751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.963793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4e5d0593-0734-4b33-9dfd-89d852e96032 None None] MFA Rules not processed for user `02d95a026009485ab5b847893c3b003b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:35.964827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 812/1607] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:35.965038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4e5d0593-0734-4b33-9dfd-89d852e96032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:35.965694 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:35.976016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23891083-88c8-4efb-a92b-fc39ca29acd5 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:35.981170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:35.981791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:35.982182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:35.982348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:35.982953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:35.984748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:35.998561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 813/1608] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:35.998561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.010807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3437a77-0d98-4db5-9f3f-376a98f579e4 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.015981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96154a00-3a50-454a-9422-47cbfac763b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.016829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96154a00-3a50-454a-9422-47cbfac763b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.017206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96154a00-3a50-454a-9422-47cbfac763b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.017605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96154a00-3a50-454a-9422-47cbfac763b4 admin admin] PATH_INFO: `/v3/projects/365b531db2bd40049e0b98b92169cc99/users/813ead9f2fe7411da1c4e16c3f09b58f/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.038738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96154a00-3a50-454a-9422-47cbfac763b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365b531db2bd40049e0b98b92169cc99, user_id=813ead9f2fe7411da1c4e16c3f09b58f, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.042844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96154a00-3a50-454a-9422-47cbfac763b4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.048524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 796/1609] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:36.050107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc43d-e39d-444f-a442-e619246be2cd None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.050502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc43d-e39d-444f-a442-e619246be2cd None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.050833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc43d-e39d-444f-a442-e619246be2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.065770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 814/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:35 2022] PUT /identity/v3/projects/365b531db2bd40049e0b98b92169cc99/users/813ead9f2fe7411da1c4e16c3f09b58f/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:36.066953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55327-c37f-4039-bb1c-72915449cf33 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.067274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55327-c37f-4039-bb1c-72915449cf33 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.067861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f55327-c37f-4039-bb1c-72915449cf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.074978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-74cfc43d-e39d-444f-a442-e619246be2cd None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:36.076436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-74cfc43d-e39d-444f-a442-e619246be2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:36.077139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:36.104851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c6f55327-c37f-4039-bb1c-72915449cf33 None None] MFA Rules not processed for user `8d970010dbea4075952b01f285c66238`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:36.107176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c6f55327-c37f-4039-bb1c-72915449cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:36.157251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 797/1611] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:36.157251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc43d-e39d-444f-a442-e619246be2cd None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.167564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc43d-e39d-444f-a442-e619246be2cd None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.172716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.173366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.173641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.173908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.174703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.176233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.193843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 798/1612] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:36.194079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 815/1613] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:36.194183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.194368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b20e9-5c5e-4529-9b9e-ea52e1b9fbc0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.194368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b20e9-5c5e-4529-9b9e-ea52e1b9fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.194368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b20e9-5c5e-4529-9b9e-ea52e1b9fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.211179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b345-a4cd-45aa-a532-c0abb9de6ca6 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.217009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69232d3-128e-43c3-837f-3a109a7a830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.217684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69232d3-128e-43c3-837f-3a109a7a830e admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.217965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69232d3-128e-43c3-837f-3a109a7a830e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.218232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69232d3-128e-43c3-837f-3a109a7a830e admin admin] PATH_INFO: `/v3/projects/d7b470dff8e048968bf8ffe9410f1092/users/e270bd406d644bf89649f40f66166430/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.227057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-668b20e9-5c5e-4529-9b9e-ea52e1b9fbc0 None None] MFA Rules not processed for user `813ead9f2fe7411da1c4e16c3f09b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:36.228690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-668b20e9-5c5e-4529-9b9e-ea52e1b9fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:36.235215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69232d3-128e-43c3-837f-3a109a7a830e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b470dff8e048968bf8ffe9410f1092, user_id=e270bd406d644bf89649f40f66166430, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.238511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69232d3-128e-43c3-837f-3a109a7a830e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.254259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 799/1614] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:36 2022] PUT /identity/v3/projects/d7b470dff8e048968bf8ffe9410f1092/users/e270bd406d644bf89649f40f66166430/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:36.259393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bc6d6-c8c3-4e99-805e-e5418d55f334 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.259393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bc6d6-c8c3-4e99-805e-e5418d55f334 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.259393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bc6d6-c8c3-4e99-805e-e5418d55f334 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.259393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 800/1615] 10.222.0.42 () {54 vars in 962 bytes} [Thu Sep 15 12:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:58:36.260437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bc6d6-c8c3-4e99-805e-e5418d55f334 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.363577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 816/1616] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:36.364564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b20e9-5c5e-4529-9b9e-ea52e1b9fbc0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.377005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:36.383884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bc6d6-c8c3-4e99-805e-e5418d55f334 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.389188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.390040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.391126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.391545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.400236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b20e9-5c5e-4529-9b9e-ea52e1b9fbc0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.496773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccbffc-c78c-4d9b-ac48-e242c8fe47bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.497891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbffc-c78c-4d9b-ac48-e242c8fe47bc admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.498320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbffc-c78c-4d9b-ac48-e242c8fe47bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.498768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbffc-c78c-4d9b-ac48-e242c8fe47bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.499747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccbffc-c78c-4d9b-ac48-e242c8fe47bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.499959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.501786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.502844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccbffc-c78c-4d9b-ac48-e242c8fe47bc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.515599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 801/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:36.516659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.529087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f60f4-5718-4a75-80a7-2167ef0213aa service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.535560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689db7e5-946b-4cb4-b618-eb5b67c970c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.536695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689db7e5-946b-4cb4-b618-eb5b67c970c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.537080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689db7e5-946b-4cb4-b618-eb5b67c970c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.537581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689db7e5-946b-4cb4-b618-eb5b67c970c8 admin admin] PATH_INFO: `/v3/projects/251edca3bc03440e9c31a11a84352c60/users/468321c119c44f37a44aeca77aa439a9/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.542689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 817/1618] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:36.544596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea7b5-55f2-4e34-bf04-a4748efc1b24 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.545085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea7b5-55f2-4e34-bf04-a4748efc1b24 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.546529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea7b5-55f2-4e34-bf04-a4748efc1b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.555674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689db7e5-946b-4cb4-b618-eb5b67c970c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251edca3bc03440e9c31a11a84352c60, user_id=468321c119c44f37a44aeca77aa439a9, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.559348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689db7e5-946b-4cb4-b618-eb5b67c970c8 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.575130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-61cea7b5-55f2-4e34-bf04-a4748efc1b24 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:36.577412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-61cea7b5-55f2-4e34-bf04-a4748efc1b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:36.583986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 802/1619] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:36 2022] PUT /identity/v3/projects/251edca3bc03440e9c31a11a84352c60/users/468321c119c44f37a44aeca77aa439a9/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:36.583986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bac5-d423-4645-8425-b8cc5235a972 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.583986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bac5-d423-4645-8425-b8cc5235a972 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.583986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bac5-d423-4645-8425-b8cc5235a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.586096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:36.652113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-abc0bac5-d423-4645-8425-b8cc5235a972 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:36.653744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-abc0bac5-d423-4645-8425-b8cc5235a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:36.671321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 818/1620] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:36.674035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362bbd2-7c83-4156-8dcd-4b4b5c370136 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.674479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362bbd2-7c83-4156-8dcd-4b4b5c370136 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.674912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362bbd2-7c83-4156-8dcd-4b4b5c370136 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.679237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 819/1621] 10.222.0.42 () {54 vars in 962 bytes} [Thu Sep 15 12:58:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:58:36.687765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362bbd2-7c83-4156-8dcd-4b4b5c370136 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.711328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362bbd2-7c83-4156-8dcd-4b4b5c370136 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.719960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38330df-a887-4773-b472-ea8941b26b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.720996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38330df-a887-4773-b472-ea8941b26b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.721511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38330df-a887-4773-b472-ea8941b26b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.722136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38330df-a887-4773-b472-ea8941b26b7b admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.723235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38330df-a887-4773-b472-ea8941b26b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.727262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38330df-a887-4773-b472-ea8941b26b7b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.740944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 803/1622] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:36.741988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bac5-d423-4645-8425-b8cc5235a972 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.754509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bac5-d423-4645-8425-b8cc5235a972 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.759430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.760107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.760450 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.760774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.761580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.762072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 820/1623] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/users => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:36.764000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff023f9-378c-4977-a9d6-36b1e7d69a4d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.764519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff023f9-378c-4977-a9d6-36b1e7d69a4d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.765008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff023f9-378c-4977-a9d6-36b1e7d69a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.766602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.779426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 804/1624] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:36.780444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.784183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:36.792320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0ff023f9-378c-4977-a9d6-36b1e7d69a4d None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:36.793949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0ff023f9-378c-4977-a9d6-36b1e7d69a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:36.810735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 821/1625] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Sep 15 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:36.812990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff023f9-378c-4977-a9d6-36b1e7d69a4d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.832439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff023f9-378c-4977-a9d6-36b1e7d69a4d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.841832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.842477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.842760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.843096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.856990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:36.881657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0812-3c97-459c-bb29-f00b0be20b8d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.901201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.901976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.903537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.904157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.922975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.924891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.936136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.940260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:36.950560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 822/1626] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:36.952083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.974788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 805/1627] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:36.976083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:36.979736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f2621-f167-454e-8b25-8b1a38a226a8 service nova] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:36.990466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:36.991222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:36.991501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:36.991818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:36.992560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:36.994401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:37.005797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af600bc-ce37-40cd-8f85-833e848c3de4 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:37.018631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:37.020366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.021867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.022848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] PATH_INFO: `/v3/projects/251edca3bc03440e9c31a11a84352c60/users/468321c119c44f37a44aeca77aa439a9/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.027381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251edca3bc03440e9c31a11a84352c60, user_id=468321c119c44f37a44aeca77aa439a9, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:37.030066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 823/1628] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:37.031022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:37.035300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:37.063391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239fc51-f956-4833-91b4-58328fc408d7 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:37.080931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 806/1629] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:36 2022] PUT /identity/v3/projects/251edca3bc03440e9c31a11a84352c60/users/468321c119c44f37a44aeca77aa439a9/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:37.082084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:37.157902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a9f96-65cf-4d6e-8b92-9df445a0346e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:37.158962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9f96-65cf-4d6e-8b92-9df445a0346e service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.159129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9f96-65cf-4d6e-8b92-9df445a0346e service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.159297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a9f96-65cf-4d6e-8b92-9df445a0346e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.175357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:37.235684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3e04d-28e4-48bc-b02c-ba685bbb9311 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:37.246298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:37.250377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.250732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.251165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] PATH_INFO: `/v3/projects/03ad80010de04e8094fa885bf6c305ec/users/54c5c0f35f7443acb6c18ce9c06a655e/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.253877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a9f96-65cf-4d6e-8b92-9df445a0346e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:37.256415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a9f96-65cf-4d6e-8b92-9df445a0346e service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:37.273806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 824/1630] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:37.275637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b03c0-25ec-4481-8fdc-13ed5eeb1bdd None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.276177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b03c0-25ec-4481-8fdc-13ed5eeb1bdd None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.276925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b03c0-25ec-4481-8fdc-13ed5eeb1bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.299262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ad80010de04e8094fa885bf6c305ec, user_id=54c5c0f35f7443acb6c18ce9c06a655e, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:37.305880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:37.325248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8a9b03c0-25ec-4481-8fdc-13ed5eeb1bdd None None] MFA Rules not processed for user `468321c119c44f37a44aeca77aa439a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:37.327476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8a9b03c0-25ec-4481-8fdc-13ed5eeb1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:37.359650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 807/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:37 2022] PUT /identity/v3/projects/03ad80010de04e8094fa885bf6c305ec/users/54c5c0f35f7443acb6c18ce9c06a655e/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:37.361123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:37.493888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 825/1632] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:37.498059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48e63-9b41-4e30-977f-064d08580a01 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.498210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48e63-9b41-4e30-977f-064d08580a01 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.499312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48e63-9b41-4e30-977f-064d08580a01 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.504133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 826/1633] 10.222.0.42 () {54 vars in 912 bytes} [Thu Sep 15 12:58:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:58:37.510032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5fd4-780d-408d-a744-919558f67cb0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.510420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5fd4-780d-408d-a744-919558f67cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.511042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5fd4-780d-408d-a744-919558f67cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.525954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095bc5c-6b37-47f4-bb62-6b0f58dab0dc admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:37.531519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:37.532983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.533262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.533533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.534334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:37.536231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-75bb5fd4-780d-408d-a744-919558f67cb0 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:37.536489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:37.537811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-75bb5fd4-780d-408d-a744-919558f67cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:37.550460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 808/1634] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:37.551342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:37.678169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2443c-3719-48a8-8958-459d3b54220f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:37.694378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0df1d0-d934-4348-bd9d-2cc4cf16050f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:37.695900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df1d0-d934-4348-bd9d-2cc4cf16050f service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.696552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df1d0-d934-4348-bd9d-2cc4cf16050f service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.698370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0df1d0-d934-4348-bd9d-2cc4cf16050f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.713018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:37.720490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 827/1635] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:37.721439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5fd4-780d-408d-a744-919558f67cb0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:37.754312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5fd4-780d-408d-a744-919558f67cb0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:37.768461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:37.769566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.769998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.770427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] PATH_INFO: `/v3/projects/03ad80010de04e8094fa885bf6c305ec/users/54c5c0f35f7443acb6c18ce9c06a655e/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.772675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ad80010de04e8094fa885bf6c305ec, user_id=54c5c0f35f7443acb6c18ce9c06a655e, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:37.775909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:37.811035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 828/1636] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:37 2022] PUT /identity/v3/projects/03ad80010de04e8094fa885bf6c305ec/users/54c5c0f35f7443acb6c18ce9c06a655e/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:37.812385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:37.835072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df1d0-d934-4348-bd9d-2cc4cf16050f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:37.838680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0df1d0-d934-4348-bd9d-2cc4cf16050f service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:37.849708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:37.881263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 809/1637] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:37.883650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d285ae-a5b4-4802-a24b-158bbfb952f5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:37.884738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d285ae-a5b4-4802-a24b-158bbfb952f5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:37.886076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d285ae-a5b4-4802-a24b-158bbfb952f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:37.985997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-82d285ae-a5b4-4802-a24b-158bbfb952f5 None None] MFA Rules not processed for user `54c5c0f35f7443acb6c18ce9c06a655e`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:37.987257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-82d285ae-a5b4-4802-a24b-158bbfb952f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:38.009484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb232-0107-4e05-bfef-a57b4c25aa8a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:38.022882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:38.023650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:38.024031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:38.024360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:38.151883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 810/1638] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:38.155060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc2edd-af9c-473b-9414-5fe272f19b2d None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:38.155495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc2edd-af9c-473b-9414-5fe272f19b2d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:38.155833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc2edd-af9c-473b-9414-5fe272f19b2d None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:38.157934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 811/1639] 10.222.0.42 () {54 vars in 912 bytes} [Thu Sep 15 12:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:58:38.168041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6a98f-ef51-463f-884a-dd626ce2920b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:38.168041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6a98f-ef51-463f-884a-dd626ce2920b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:38.168041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6a98f-ef51-463f-884a-dd626ce2920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:38.182600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:38.184688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:38.203457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-36c6a98f-ef51-463f-884a-dd626ce2920b None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:38.204925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-36c6a98f-ef51-463f-884a-dd626ce2920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:38.210016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 829/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:38.211410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:38.227008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a3660-f0c2-42ef-88f1-08e96dbc58ef service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:38.229783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 812/1641] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 12:58:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:38.243912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:38.244551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:38.244819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:38.245077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:38.265414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:38.268366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:38.293829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 830/1642] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:38.437020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6a98f-ef51-463f-884a-dd626ce2920b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:38.453392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6a98f-ef51-463f-884a-dd626ce2920b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:38.462598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:38.463869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:38.464864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:38.466129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:38.491975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:38.495282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:38.511747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 813/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:38.806056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:38.823739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da12d0-a731-41e8-8c57-67fd69af108e service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:38.828490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211e3f-4b78-4cbf-8c19-39c5d176f56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:38.829410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211e3f-4b78-4cbf-8c19-39c5d176f56b service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:38.829908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211e3f-4b78-4cbf-8c19-39c5d176f56b service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:38.830397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211e3f-4b78-4cbf-8c19-39c5d176f56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:38.952255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211e3f-4b78-4cbf-8c19-39c5d176f56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:38.956159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211e3f-4b78-4cbf-8c19-39c5d176f56b service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:38.988412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 831/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:58:39.347495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:39.571682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e21fd-d29d-41f3-ac98-b590b25a6087 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:39.605483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:39.606480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:39.606900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:39.607296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] PATH_INFO: `/v3/users/813ead9f2fe7411da1c4e16c3f09b58f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:39.609485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=813ead9f2fe7411da1c4e16c3f09b58f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:39.610709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: WARNING py.warnings [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:58:39.610709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: warnings.warn(msg) Sep 15 12:58:39.610709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: Sep 15 12:58:39.612525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:39.646018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:39.795224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813ead9f2fe7411da1c4e16c3f09b58f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:39.823135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813ead9f2fe7411da1c4e16c3f09b58f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:39.824091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813ead9f2fe7411da1c4e16c3f09b58f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:39.825081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813ead9f2fe7411da1c4e16c3f09b58f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:39.858862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813ead9f2fe7411da1c4e16c3f09b58f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:39.920273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 814/1645] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:39 2022] DELETE /identity/v3/users/813ead9f2fe7411da1c4e16c3f09b58f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:39.924767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:39.925899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:39.926337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:39.969625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:39.971164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:39.971302 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:39.973240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:40.020741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:40.056026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 832/1646] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:40.098633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e7b35-7246-4fb8-a645-81865d7df25e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:40.104433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:40.105350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:40.105792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:40.107144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] PATH_INFO: `/v3/users/94e1cd16edbb4795b4dfb690910488ec` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:40.108715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e1cd16edbb4795b4dfb690910488ec)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:40.111300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:40.142331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:40.144444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:40.343444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e1cd16edbb4795b4dfb690910488ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:40.373824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e1cd16edbb4795b4dfb690910488ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:40.374896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e1cd16edbb4795b4dfb690910488ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:40.376309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e1cd16edbb4795b4dfb690910488ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:40.379834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f468-8239-4db4-abba-b95a089c2278 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:40.388261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-234efd54-a64b-48b6-9f9e-e436543075f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e1cd16edbb4795b4dfb690910488ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:40.391475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:40.392407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:40.392733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:40.393090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:40.395132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:40.434403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:40.442947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:40.457249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 815/1647] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:39 2022] DELETE /identity/v3/users/94e1cd16edbb4795b4dfb690910488ec => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:58:40.467564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:40.467952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:40.468236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:40.474053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 833/1648] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:40.482153 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:40.521121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:40.524259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:40.634531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 816/1649] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:40.731852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:40.733559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:40.762928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85725c-5588-4b24-867a-3b3f564221c7 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:40.859573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:40.860313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:40.860648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:40.860974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:40.874981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:40.877635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:40.892501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 834/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:42.018870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:42.020821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:42.060571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd40b0-f950-4fe8-b313-f5e349d6eed9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:42.070675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:42.071344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:42.071617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:42.071908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] PATH_INFO: `/v3/projects/365b531db2bd40049e0b98b92169cc99` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:42.077668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365b531db2bd40049e0b98b92169cc99)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:42.087761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:42.226535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365b531db2bd40049e0b98b92169cc99', 'request_id': 'req-6645ec43-c706-41ce-9d85-1ad9682b86a4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.238247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:42.239992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:42.262243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed4fb-5566-47fe-957e-382e6aa7edda service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:42.263995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365b531db2bd40049e0b98b92169cc99', 'request_id': 'req-6645ec43-c706-41ce-9d85-1ad9682b86a4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.277548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365b531db2bd40049e0b98b92169cc99', 'request_id': 'req-6645ec43-c706-41ce-9d85-1ad9682b86a4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.323480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] The token cache is being invalidate because project 365b531db2bd40049e0b98b92169cc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:42.323824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.325698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6645ec43-c706-41ce-9d85-1ad9682b86a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.334162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 817/1651] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:42 2022] DELETE /identity/v3/projects/365b531db2bd40049e0b98b92169cc99 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:42.336086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ff7b-fea8-496d-bd37-7d2e4c6139cd None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:42.338716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ff7b-fea8-496d-bd37-7d2e4c6139cd None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:42.339011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738ff7b-fea8-496d-bd37-7d2e4c6139cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:42.390735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-6738ff7b-fea8-496d-bd37-7d2e4c6139cd None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:42.392010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6738ff7b-fea8-496d-bd37-7d2e4c6139cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:42.464657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:42.465483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:42.465908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:42.466225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] PATH_INFO: `/v3/users/02d95a026009485ab5b847893c3b003b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:42.470557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d95a026009485ab5b847893c3b003b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:42.480517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:42.560527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:42.598516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 818/1652] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:42.606640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b46db-0d2d-470d-b22c-6b0f8b2d14b7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:42.606887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d95a026009485ab5b847893c3b003b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.609115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b46db-0d2d-470d-b22c-6b0f8b2d14b7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:42.609560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b46db-0d2d-470d-b22c-6b0f8b2d14b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:42.626964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d95a026009485ab5b847893c3b003b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.637114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d95a026009485ab5b847893c3b003b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.638510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d95a026009485ab5b847893c3b003b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.646977 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0b2b46db-0d2d-470d-b22c-6b0f8b2d14b7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:42.651090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0b2b46db-0d2d-470d-b22c-6b0f8b2d14b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:42.663070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3afdbac8-2851-4c6b-9596-df817dd62b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d95a026009485ab5b847893c3b003b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:42.674651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 835/1653] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:42 2022] DELETE /identity/v3/users/02d95a026009485ab5b847893c3b003b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:42.676851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 819/1654] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:42.682054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b46db-0d2d-470d-b22c-6b0f8b2d14b7 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:42.682673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6f8f-e215-4c40-a2c8-a0fac9d2a2e4 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:42.682965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6f8f-e215-4c40-a2c8-a0fac9d2a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:42.683289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6f8f-e215-4c40-a2c8-a0fac9d2a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:42.694925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b46db-0d2d-470d-b22c-6b0f8b2d14b7 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:42.719266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:42.727749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2f7a6f8f-e215-4c40-a2c8-a0fac9d2a2e4 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:42.729185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2f7a6f8f-e215-4c40-a2c8-a0fac9d2a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:42.842867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:42.843519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:42.845290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:42.845473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:42.848711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:42.849042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:42.853635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:42.917116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 820/1655] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:58:42.921875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:42.945817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55949-2266-4df7-bba3-78109f47ad94 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:42.985415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:42.986074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:42.986354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:42.986620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:42.987272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:42.988294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 836/1656] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:42.992247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:43.091719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a6f8f-e215-4c40-a2c8-a0fac9d2a2e4 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:43.100698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 821/1657] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:42 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:43.110421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a6f8f-e215-4c40-a2c8-a0fac9d2a2e4 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:43.125943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:43.131852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:43.298427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:43.299632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:43.299980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:43.300207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:43.300954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:43.304322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:43.355293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 837/1658] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:43 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:58:43.359306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:43.366173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a9d91-854f-4564-ae4f-70f283b8e585 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:43.386851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:43.388570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:43.388914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:43.389239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:43.396205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be6a2d-98f7-4fc9-9e97-f4b9b609aff0 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:43.414348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:43.414990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:43.415259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:43.415521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:43.422100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:43.430396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:43.442369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:43.444297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:43.474965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 838/1659] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:43.477689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 822/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:43.480988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:43.519690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce39ae-fcf6-4ed5-b61e-db6d30c38ecb admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:43.539821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef60f3-b52f-4c3f-87db-5d74c363fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:43.541123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef60f3-b52f-4c3f-87db-5d74c363fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:43.542130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef60f3-b52f-4c3f-87db-5d74c363fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:43.542588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef60f3-b52f-4c3f-87db-5d74c363fe77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:43.544243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef60f3-b52f-4c3f-87db-5d74c363fe77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:43.547983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef60f3-b52f-4c3f-87db-5d74c363fe77 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:43.584433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 839/1661] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:43.594617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:43.610139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0b5d5-a1f0-4270-8f27-771619ded2ec service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:43.628433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:43.629154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:43.629433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:43.629704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] PATH_INFO: `/v3/projects/c5d3285e5591486e92a1fbc2f69171c4/users/ddea3fda4b5149588ce1f539a6e794c8/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:43.672842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d3285e5591486e92a1fbc2f69171c4, user_id=ddea3fda4b5149588ce1f539a6e794c8, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:43.675987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:43.710983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 823/1662] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:43 2022] PUT /identity/v3/projects/c5d3285e5591486e92a1fbc2f69171c4/users/ddea3fda4b5149588ce1f539a6e794c8/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:43.723305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f302-2cd8-4a48-bda3-dd111e61d6d2 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:43.724010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f302-2cd8-4a48-bda3-dd111e61d6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:43.725162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f302-2cd8-4a48-bda3-dd111e61d6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:43.734309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:43.736389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:43.842543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:43.857961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1303f302-2cd8-4a48-bda3-dd111e61d6d2 None None] MFA Rules not processed for user `ddea3fda4b5149588ce1f539a6e794c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:43.859492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1303f302-2cd8-4a48-bda3-dd111e61d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:43.940781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f3298-956e-4155-8177-a70adc687270 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:43.965501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:43.965734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:43.966082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:43.972048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] PATH_INFO: `/v3/users/8d970010dbea4075952b01f285c66238` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:43.973527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d970010dbea4075952b01f285c66238)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:43.977832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:44.064386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:44.111771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 840/1663] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:44.115828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f302-2cd8-4a48-bda3-dd111e61d6d2 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:44.151327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f302-2cd8-4a48-bda3-dd111e61d6d2 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:44.201218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d970010dbea4075952b01f285c66238'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:44.202883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:44.204749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:44.205035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:44.206850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:44.209229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:44.214671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:44.225051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d970010dbea4075952b01f285c66238'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:44.226213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d970010dbea4075952b01f285c66238'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:44.227064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d970010dbea4075952b01f285c66238'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:44.279423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-73d2af76-8dde-48a3-95b1-ae4c4e9d9079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d970010dbea4075952b01f285c66238'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:44.348884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 824/1664] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:43 2022] DELETE /identity/v3/users/8d970010dbea4075952b01f285c66238 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:44.353598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 841/1665] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:44 2022] POST /identity/v3/projects => generated 405 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:44.355160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:44.358947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:44.366410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:44.367065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:44.368434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:44.451356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:44.453696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:44.621224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9fbe4-0988-4378-8105-29b58eb956af admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:44.662910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 825/1666] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:44.774271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:44.775364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:44.775742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:44.776060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:44.776700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:44.779136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:44.810832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:44.812994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:44.821444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 842/1667] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:44 2022] POST /identity/v3/users => generated 309 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:44.825614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:44.850925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb43b3-680b-44e3-bf81-90f1cac9d1b9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:44.864469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:44.866349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:44.867024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:44.869803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:44.870423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:44.872295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:44.907970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 843/1668] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:44.911570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:44.943954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89613d56-ebc3-4932-984e-6d60ddf69596 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:44.955562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551f0b2-b1ce-4dde-995e-76e1d76a220f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:44.958557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:44.960868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:44.961424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:44.961866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:44.961997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:44.962365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:44.962726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:44.964235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] PATH_INFO: `/v3/projects/62216d326ee149f0af922b0224e6f8c6/users/4d70c39980b04bffa5645a2670948fe6/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:44.972000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:44.993926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:44.999924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:45.018636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62216d326ee149f0af922b0224e6f8c6, user_id=4d70c39980b04bffa5645a2670948fe6, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:45.019162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 826/1669] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:58:45.021425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:45.022607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:45.024004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:45.062683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 844/1670] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:44 2022] PUT /identity/v3/projects/62216d326ee149f0af922b0224e6f8c6/users/4d70c39980b04bffa5645a2670948fe6/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:45.065859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad4c9f-97ac-4016-bfa3-1d11bfe8e0dd service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:45.066736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:45.159087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:45.201799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5db2f-ca85-44bf-9f32-4c86dd071e3e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:45.208250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:45.208884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:45.209156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:45.209419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:45.210326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:45.212050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:45.224497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:45.225917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:45.226192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:45.226458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] PATH_INFO: `/v3/projects/c2a6fab289e7446dbcd3ccc52b961a9f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:45.232176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a6fab289e7446dbcd3ccc52b961a9f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:45.238662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:45.248448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 845/1671] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:58:45.253372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:45.269622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9693c-718a-43ea-a94d-d99eb2e28ea6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:45.278842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b6975-4aa6-40c3-bb99-6450801499e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:45.279692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b6975-4aa6-40c3-bb99-6450801499e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:45.280234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b6975-4aa6-40c3-bb99-6450801499e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:45.280574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b6975-4aa6-40c3-bb99-6450801499e9 admin admin] PATH_INFO: `/v3/projects/62216d326ee149f0af922b0224e6f8c6/users/4d70c39980b04bffa5645a2670948fe6/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:45.286841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b6975-4aa6-40c3-bb99-6450801499e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62216d326ee149f0af922b0224e6f8c6, user_id=4d70c39980b04bffa5645a2670948fe6, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:45.294600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b6975-4aa6-40c3-bb99-6450801499e9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:45.361922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a6fab289e7446dbcd3ccc52b961a9f', 'request_id': 'req-b0e119b1-bad8-460a-b422-b659a8feef84'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.403798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 846/1672] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:45 2022] PUT /identity/v3/projects/62216d326ee149f0af922b0224e6f8c6/users/4d70c39980b04bffa5645a2670948fe6/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:45.406064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a6fab289e7446dbcd3ccc52b961a9f', 'request_id': 'req-b0e119b1-bad8-460a-b422-b659a8feef84'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.411771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:45.422691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:45.424433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:45.434288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a6fab289e7446dbcd3ccc52b961a9f', 'request_id': 'req-b0e119b1-bad8-460a-b422-b659a8feef84'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.467058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] The token cache is being invalidate because project c2a6fab289e7446dbcd3ccc52b961a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:45.467261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.468025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.472786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 827/1673] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:45 2022] DELETE /identity/v3/projects/c2a6fab289e7446dbcd3ccc52b961a9f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:45.474035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:45.475556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:45.518666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] MFA Rules not processed for user `4d70c39980b04bffa5645a2670948fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:45.520880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:45.637755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e119b1-bad8-460a-b422-b659a8feef84 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:45.721958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 847/1674] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:45.732390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:45.733940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:45.794392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:45.795248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:45.795536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:45.797281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] PATH_INFO: `/v3/users/468321c119c44f37a44aeca77aa439a9` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:45.798857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468321c119c44f37a44aeca77aa439a9)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:45.801069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:45.827387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:45.878948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f14a-15dd-4f0b-92e7-9aea5ba99c50 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:45.884723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:45.893521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:45.896579 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:45.897942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:45.920020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:45.920968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468321c119c44f37a44aeca77aa439a9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.929892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:45.932093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:45.942189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468321c119c44f37a44aeca77aa439a9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.942851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468321c119c44f37a44aeca77aa439a9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.944145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468321c119c44f37a44aeca77aa439a9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.971164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468321c119c44f37a44aeca77aa439a9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:45.989161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 848/1675] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:45 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:58:45.991424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:45.998722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:46.068072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 828/1676] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:45 2022] DELETE /identity/v3/users/468321c119c44f37a44aeca77aa439a9 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:58:46.085479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787c0f5-046b-4271-a5a2-e0073ec2210c service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:46.228770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:46.229254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:46.229561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:46.229768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] PATH_INFO: `/v3/projects/6a8da0bef4a14d569721ae51684cebac` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:46.231051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8da0bef4a14d569721ae51684cebac)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:46.232130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: WARNING py.warnings [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:58:46.232130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: warnings.warn(msg) Sep 15 12:58:46.232130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: Sep 15 12:58:46.233426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:46.254461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:46.256115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:46.275127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f700-961b-46ab-9826-de24ca39bb03 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:46.285976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:46.286179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:46.286379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:46.295754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] PATH_INFO: `/v3/users/ddea3fda4b5149588ce1f539a6e794c8` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:46.297122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddea3fda4b5149588ce1f539a6e794c8)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:46.299280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:46.366643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8da0bef4a14d569721ae51684cebac', 'request_id': 'req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.394628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8da0bef4a14d569721ae51684cebac', 'request_id': 'req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.402160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8da0bef4a14d569721ae51684cebac', 'request_id': 'req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.446830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddea3fda4b5149588ce1f539a6e794c8'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.451218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] The token cache is being invalidate because project 6a8da0bef4a14d569721ae51684cebac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:46.451777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.455178 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1465fa8e-1da7-4264-bac7-1fa82f4f3f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.457849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 849/1677] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:45 2022] DELETE /identity/v3/projects/6a8da0bef4a14d569721ae51684cebac => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:46.466028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26122801-39b3-45c0-8136-6dd5b0ded630 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:46.466439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26122801-39b3-45c0-8136-6dd5b0ded630 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:46.466560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26122801-39b3-45c0-8136-6dd5b0ded630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:46.472997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddea3fda4b5149588ce1f539a6e794c8'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.473672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddea3fda4b5149588ce1f539a6e794c8'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.474281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddea3fda4b5149588ce1f539a6e794c8'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.484078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-be2d9719-ddc6-4fde-b18d-13b181428f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddea3fda4b5149588ce1f539a6e794c8'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:46.513583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-26122801-39b3-45c0-8136-6dd5b0ded630 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:46.515863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-26122801-39b3-45c0-8136-6dd5b0ded630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:46.531103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 829/1678] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:46 2022] DELETE /identity/v3/users/ddea3fda4b5149588ce1f539a6e794c8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:58:46.533193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:46.533505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:46.533759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:46.583431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:46.584729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:46.610877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 850/1679] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:46.619346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afc12-cee3-45e8-8864-ec1fddb520b8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:46.619799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afc12-cee3-45e8-8864-ec1fddb520b8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:46.620166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afc12-cee3-45e8-8864-ec1fddb520b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:46.668636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0d0afc12-cee3-45e8-8864-ec1fddb520b8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:46.669989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0d0afc12-cee3-45e8-8864-ec1fddb520b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:46.711467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 830/1680] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:46.723333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:46.780561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:46.782425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:46.799529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:46.885172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 851/1681] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:58:46.887165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afc12-cee3-45e8-8864-ec1fddb520b8 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:46.904301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afc12-cee3-45e8-8864-ec1fddb520b8 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:46.911154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:46.924839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:46.926130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:46.928098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:46.929533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe2c87-a089-48d9-b18b-e1c6ee4bf137 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:46.930430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:46.931798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:46.939449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:46.940584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:46.941248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:46.941523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:46.941792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:46.974355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:46.975877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:46.980581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 852/1682] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:46.984216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:46.995279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 831/1683] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:47.008460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1ede7-aebd-4ddb-84b0-1e6cbcfd9f80 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:47.040175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:47.040819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:47.041094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:47.041362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:47.042002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:47.044477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:47.121871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 853/1684] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:46 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:58:47.123231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:47.143274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718d9ce-f9a9-464e-be42-fa7588211dd6 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:47.340094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:47.343025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:47.345437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:47.345961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:47.347666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:47.354431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:47.419107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 832/1685] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:47 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:47.424014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:47.446753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abe16-9d37-4a92-a41b-a8a175329301 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:47.462568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:47.464047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:47.464941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:47.465468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:47.466794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:47.477534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:47.505267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:47.505978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 854/1686] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:47.520815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16382a3-6232-42cc-b94d-c5b379aa73b9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:47.529325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde6ed-3d82-4abb-91f2-59737b2446d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:47.531161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde6ed-3d82-4abb-91f2-59737b2446d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:47.531440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde6ed-3d82-4abb-91f2-59737b2446d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:47.531734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde6ed-3d82-4abb-91f2-59737b2446d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:47.532391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bde6ed-3d82-4abb-91f2-59737b2446d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:47.537034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bde6ed-3d82-4abb-91f2-59737b2446d2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:47.562631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 833/1687] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:58:47.566892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:47.594328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02b674-9ae8-45ff-aac5-e1bd7fb33e2b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:47.613606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:47.615172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:47.618522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:47.620950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] PATH_INFO: `/v3/projects/30626024bfee42698e9333e6f19150e2/users/9f95766d7b8445dd8d21142ad1cab05c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:47.678105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30626024bfee42698e9333e6f19150e2, user_id=9f95766d7b8445dd8d21142ad1cab05c, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:47.681661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:47.739580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 855/1688] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:47 2022] PUT /identity/v3/projects/30626024bfee42698e9333e6f19150e2/users/9f95766d7b8445dd8d21142ad1cab05c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:47.751549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:47.752131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:47.753839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:47.804380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:47.811620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:47.814606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] MFA Rules not processed for user `9f95766d7b8445dd8d21142ad1cab05c`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:47.816296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:47.941721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24713f-a9e2-4b90-91fd-3d3a085c2a7c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:47.953063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:47.955326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:47.955620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:47.955910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] PATH_INFO: `/v3/projects/251edca3bc03440e9c31a11a84352c60` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:47.962089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251edca3bc03440e9c31a11a84352c60)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:47.965693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:47.979242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 834/1689] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:47.981681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:47.985137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:48.020112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9800-1f88-42d7-82e6-a328425a2d01 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:48.031543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:48.032679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.034005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.034196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] PATH_INFO: `/v3/projects/b9b5988412cc43c5b41f41222d314516` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:48.036791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b5988412cc43c5b41f41222d314516)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:48.038630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:48.078890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:48.087013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251edca3bc03440e9c31a11a84352c60', 'request_id': 'req-4d2b64ed-4eae-4952-91be-be66688d78a5'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.109919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251edca3bc03440e9c31a11a84352c60', 'request_id': 'req-4d2b64ed-4eae-4952-91be-be66688d78a5'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.111933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:48.118851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251edca3bc03440e9c31a11a84352c60', 'request_id': 'req-4d2b64ed-4eae-4952-91be-be66688d78a5'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.157110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] The token cache is being invalidate because project 251edca3bc03440e9c31a11a84352c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:48.158986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.161126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.169279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 856/1690] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:47 2022] DELETE /identity/v3/projects/251edca3bc03440e9c31a11a84352c60 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:48.170514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:48.172316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:48.184982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b5988412cc43c5b41f41222d314516', 'request_id': 'req-c0a504ba-74c7-4208-870d-73707e63c2a0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.201496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b5988412cc43c5b41f41222d314516', 'request_id': 'req-c0a504ba-74c7-4208-870d-73707e63c2a0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.222651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b5988412cc43c5b41f41222d314516', 'request_id': 'req-c0a504ba-74c7-4208-870d-73707e63c2a0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.249340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] The token cache is being invalidate because project b9b5988412cc43c5b41f41222d314516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:48.249639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.251169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c0a504ba-74c7-4208-870d-73707e63c2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.255301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 835/1691] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:47 2022] DELETE /identity/v3/projects/b9b5988412cc43c5b41f41222d314516 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:48.258826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.259241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.259510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:48.303409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:48.306503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:48.323026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b64ed-4eae-4952-91be-be66688d78a5 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:48.463541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b7df9-6807-4b18-ade3-0c24f05dd78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:48.464954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7df9-6807-4b18-ade3-0c24f05dd78a service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.465481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7df9-6807-4b18-ade3-0c24f05dd78a service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.466027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7df9-6807-4b18-ade3-0c24f05dd78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:48.472379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-957b7df9-6807-4b18-ade3-0c24f05dd78a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:48.499315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 836/1692] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:48.499315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:48.499315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:48.515227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656d10b-095b-4385-bdab-8c678e65680b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:48.522240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:48.522893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.523166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.523433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] PATH_INFO: `/v3/users/54c5c0f35f7443acb6c18ce9c06a655e` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:48.524731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c5c0f35f7443acb6c18ce9c06a655e)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:48.528718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:48.596061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b7df9-6807-4b18-ade3-0c24f05dd78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:48.600123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b7df9-6807-4b18-ade3-0c24f05dd78a service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:48.634657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 857/1693] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:48.636714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.636996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.637266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:48.646512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c5c0f35f7443acb6c18ce9c06a655e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.670708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c5c0f35f7443acb6c18ce9c06a655e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.671566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c5c0f35f7443acb6c18ce9c06a655e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.674050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c5c0f35f7443acb6c18ce9c06a655e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.693866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c5c0f35f7443acb6c18ce9c06a655e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:48.697820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:48.700794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:48.726607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 858/1694] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:48.730807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:48.739995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:48.744620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 837/1695] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:48 2022] DELETE /identity/v3/users/54c5c0f35f7443acb6c18ce9c06a655e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:48.750946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:48.783610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb4376-b41f-4daa-aa2e-5000d61440a5 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:48.790908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:48.886941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:48.913339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:48.915259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.917836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a3188-1dac-4be3-8d51-5f117f4a8d68 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:48.919276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.919784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] PATH_INFO: `/v3/projects/c5d3285e5591486e92a1fbc2f69171c4` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:48.921706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d3285e5591486e92a1fbc2f69171c4)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:48.927817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:48.928591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.930777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.931873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:48.934209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:48.934531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:48.935279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:48.938261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:48.976704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 838/1696] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:48.978084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:48.991356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b2410-186e-4d9e-8ea5-331eff20939f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:48.998644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:48.999271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:48.999547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:48.999863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:49.000975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:49.004834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:49.072117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 839/1697] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:48 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:49.077012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:49.092718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d3285e5591486e92a1fbc2f69171c4', 'request_id': 'req-40b6f4f9-315c-42ce-9df3-e285b401d3bf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.122748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d3285e5591486e92a1fbc2f69171c4', 'request_id': 'req-40b6f4f9-315c-42ce-9df3-e285b401d3bf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.137876 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d3285e5591486e92a1fbc2f69171c4', 'request_id': 'req-40b6f4f9-315c-42ce-9df3-e285b401d3bf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.173186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] The token cache is being invalidate because project c5d3285e5591486e92a1fbc2f69171c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:49.173572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.176111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.182006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 859/1698] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:48 2022] DELETE /identity/v3/projects/c5d3285e5591486e92a1fbc2f69171c4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:49.187582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:49.190704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:49.226588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e837f9-fd1c-4fb5-81ee-3f4518e777e2 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:49.237517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:49.238298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:49.238577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:49.238848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:49.255871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:49.258244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:49.355757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 840/1699] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:49 2022] POST /identity/v3/users => generated 282 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:58:49.359264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:49.362688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:49.397460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5dd57-0645-4628-9be4-f082e474be9a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:49.409810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:49.410431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:49.410709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:49.410975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:49.411625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:49.416355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:49.425180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6f4f9-315c-42ce-9df3-e285b401d3bf admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:49.433979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:49.435102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:49.435379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:49.438194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] PATH_INFO: `/v3/users/4d70c39980b04bffa5645a2670948fe6` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:49.440899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d70c39980b04bffa5645a2670948fe6)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:49.442189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 841/1700] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:49.443906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:49.446145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:49.472310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92109c74-7857-40bf-b35c-96e001691b83 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:49.484824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:49.486979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:49.487233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:49.487503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:49.489501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:49.492757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:49.545623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 842/1701] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:49.549925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:49.562460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48a87e-e41d-484f-8fa2-93b6575365ab admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:49.582122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2e96a-9979-40cb-b7bc-5905f4ddaefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:49.583120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e96a-9979-40cb-b7bc-5905f4ddaefc admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:49.583609 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e96a-9979-40cb-b7bc-5905f4ddaefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:49.587608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e96a-9979-40cb-b7bc-5905f4ddaefc admin admin] PATH_INFO: `/v3/projects/c0a33f7f963e44dc9f5dadff60458593/users/276ffe3374f642de833b956ba41049b1/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:49.602919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d70c39980b04bffa5645a2670948fe6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.620409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2e96a-9979-40cb-b7bc-5905f4ddaefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a33f7f963e44dc9f5dadff60458593, user_id=276ffe3374f642de833b956ba41049b1, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:49.629706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d70c39980b04bffa5645a2670948fe6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.630257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2e96a-9979-40cb-b7bc-5905f4ddaefc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:49.646982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d70c39980b04bffa5645a2670948fe6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.651215 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d70c39980b04bffa5645a2670948fe6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.687586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 843/1702] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:49 2022] PUT /identity/v3/projects/c0a33f7f963e44dc9f5dadff60458593/users/276ffe3374f642de833b956ba41049b1/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:49.687895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d70c39980b04bffa5645a2670948fe6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:49.689286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e63e-99a1-4d71-a2c4-e06bb4674bd7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:49.689692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:49.693400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e63e-99a1-4d71-a2c4-e06bb4674bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:49.694757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e63e-99a1-4d71-a2c4-e06bb4674bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:49.695952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 860/1703] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:49 2022] DELETE /identity/v3/users/4d70c39980b04bffa5645a2670948fe6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:49.786747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5725e63e-99a1-4d71-a2c4-e06bb4674bd7 None None] MFA Rules not processed for user `276ffe3374f642de833b956ba41049b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:49.788306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5725e63e-99a1-4d71-a2c4-e06bb4674bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:49.820080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:49.956911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 844/1704] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:49.962380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:49.965435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:50.130309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a2afb-28d5-49fe-84e1-157e90e6c60b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:50.136699 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:50.137345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:50.137754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:50.138180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:50.138885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:50.141589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:50.215505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 861/1705] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:49 2022] POST /identity/v3/projects => generated 363 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:50.219647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e63e-99a1-4d71-a2c4-e06bb4674bd7 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:50.249669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e63e-99a1-4d71-a2c4-e06bb4674bd7 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:50.392928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:50.394097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:50.394569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:50.402647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:50.404028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:50.406246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:50.470818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 845/1706] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:50 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:50.472567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:50.486936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379bf2-409a-407e-8b0d-815a66c6605f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:50.493667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:50.499436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:50.500154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:50.500625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:50.501501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:50.503619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:50.519937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 862/1707] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:50.525002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:50.545331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d7bd2-d6ba-48e8-a217-996da1977703 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:50.555602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:50.557800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:50.562011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:50.562718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] PATH_INFO: `/v3/projects/c5e66252bc9e408fa3865002609b8300/users/88b604ae50c04c348a48996cee655944/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:50.592137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e66252bc9e408fa3865002609b8300, user_id=88b604ae50c04c348a48996cee655944, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:50.597259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:50.637711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:50.641611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 846/1708] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:50 2022] PUT /identity/v3/projects/c5e66252bc9e408fa3865002609b8300/users/88b604ae50c04c348a48996cee655944/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:50.653664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f717c0-93e0-4cf7-a6d8-bf42dfd6287e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:50.743295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:50.752376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:50.766480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4912527-a48d-4fe8-ac1e-5739f8d44d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:50.771486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4912527-a48d-4fe8-ac1e-5739f8d44d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:50.771956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4912527-a48d-4fe8-ac1e-5739f8d44d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:50.772339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4912527-a48d-4fe8-ac1e-5739f8d44d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:50.773101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4912527-a48d-4fe8-ac1e-5739f8d44d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:50.774921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4912527-a48d-4fe8-ac1e-5739f8d44d4e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:50.802833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 863/1709] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:58:50.804377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d871c3-6c3a-4a8e-9def-480d771ffdf7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:50.805948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d871c3-6c3a-4a8e-9def-480d771ffdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:50.806056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d871c3-6c3a-4a8e-9def-480d771ffdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:50.834112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334862-85c3-44bd-acff-125292e3b009 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:50.849947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:50.850785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:50.851132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:50.851521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] PATH_INFO: `/v3/projects/03ad80010de04e8094fa885bf6c305ec` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:50.854578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ad80010de04e8094fa885bf6c305ec)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:50.876226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:50.882514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-41d871c3-6c3a-4a8e-9def-480d771ffdf7 None None] MFA Rules not processed for user `05636960e9eb4dccbf9784871f79b774`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:50.883801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-41d871c3-6c3a-4a8e-9def-480d771ffdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:50.993272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ad80010de04e8094fa885bf6c305ec', 'request_id': 'req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.017407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ad80010de04e8094fa885bf6c305ec', 'request_id': 'req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.031239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ad80010de04e8094fa885bf6c305ec', 'request_id': 'req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.041788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:51.054354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 864/1710] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:51.057637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d871c3-6c3a-4a8e-9def-480d771ffdf7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:51.057883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] The token cache is being invalidate because project 03ad80010de04e8094fa885bf6c305ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:51.058221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.059775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-58c9c5c3-df8d-4703-8590-bc3cebc72bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.065546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 847/1711] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:50 2022] DELETE /identity/v3/projects/03ad80010de04e8094fa885bf6c305ec => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:51.070734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea718e0b-38bd-456c-b855-70fb7215133a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:51.071187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea718e0b-38bd-456c-b855-70fb7215133a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:51.071945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea718e0b-38bd-456c-b855-70fb7215133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:51.081740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d871c3-6c3a-4a8e-9def-480d771ffdf7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:51.093353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:51.147228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ea718e0b-38bd-456c-b855-70fb7215133a None None] MFA Rules not processed for user `1d2b0118b29b4764bd270bdcd28c363a`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:51.147228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ea718e0b-38bd-456c-b855-70fb7215133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:51.276785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29b4a-8226-42f9-b6b9-94d6d3d55e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:51.278384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29b4a-8226-42f9-b6b9-94d6d3d55e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:51.278770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29b4a-8226-42f9-b6b9-94d6d3d55e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:51.279282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29b4a-8226-42f9-b6b9-94d6d3d55e9c admin admin] PATH_INFO: `/v3/projects/c5e66252bc9e408fa3865002609b8300/users/88b604ae50c04c348a48996cee655944/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:51.283254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a29b4a-8226-42f9-b6b9-94d6d3d55e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e66252bc9e408fa3865002609b8300, user_id=88b604ae50c04c348a48996cee655944, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:51.288649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a29b4a-8226-42f9-b6b9-94d6d3d55e9c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:51.324360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 865/1712] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:51 2022] PUT /identity/v3/projects/c5e66252bc9e408fa3865002609b8300/users/88b604ae50c04c348a48996cee655944/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:51.325735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 848/1713] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:51.340095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:51.341322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90ebe-09d1-444d-a24a-48fb42aae482 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:51.341800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:51.342221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90ebe-09d1-444d-a24a-48fb42aae482 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:51.342640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:51.343046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90ebe-09d1-444d-a24a-48fb42aae482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:51.386089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-51b90ebe-09d1-444d-a24a-48fb42aae482 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:51.387663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] MFA Rules not processed for user `05636960e9eb4dccbf9784871f79b774`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:51.390460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:51.390809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-51b90ebe-09d1-444d-a24a-48fb42aae482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:51.556181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 866/1714] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:51.558379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:51.561005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:51.564171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 849/1715] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:51.567675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:51.568363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:51.568617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:51.601776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391d15c-f627-411b-b369-b3f26bf6cb08 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:51.611041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:51.612916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:51.613545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:51.616052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] PATH_INFO: `/v3/projects/62216d326ee149f0af922b0224e6f8c6` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:51.619774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62216d326ee149f0af922b0224e6f8c6)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:51.623103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:51.645680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] MFA Rules not processed for user `88b604ae50c04c348a48996cee655944`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:51.649310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:51.742095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62216d326ee149f0af922b0224e6f8c6', 'request_id': 'req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.766184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62216d326ee149f0af922b0224e6f8c6', 'request_id': 'req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.773258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62216d326ee149f0af922b0224e6f8c6', 'request_id': 'req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.801367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] The token cache is being invalidate because project 62216d326ee149f0af922b0224e6f8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:58:51.802237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.803197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:51.812999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 867/1716] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:51 2022] DELETE /identity/v3/projects/62216d326ee149f0af922b0224e6f8c6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:51.812999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:51.812999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:51.843003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 850/1717] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:51.850203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:51.853498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:51.905285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:51.912201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:52.014068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5494-89ab-42a5-a269-519562256131 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:52.036312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58284b73-3d04-4ede-8732-8a28c651d281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:52.037688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284b73-3d04-4ede-8732-8a28c651d281 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.038148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284b73-3d04-4ede-8732-8a28c651d281 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.038591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284b73-3d04-4ede-8732-8a28c651d281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.041084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-58284b73-3d04-4ede-8732-8a28c651d281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.045008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94cbd3-9503-4f5d-924a-9a3c308ffa36 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:52.056193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b242e-50f0-46b7-aab5-adaa1ef9e42b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:52.058533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b242e-50f0-46b7-aab5-adaa1ef9e42b service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.058533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b242e-50f0-46b7-aab5-adaa1ef9e42b service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.060339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b242e-50f0-46b7-aab5-adaa1ef9e42b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.065116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f15b242e-50f0-46b7-aab5-adaa1ef9e42b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.152191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58284b73-3d04-4ede-8732-8a28c651d281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:52.155307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58284b73-3d04-4ede-8732-8a28c651d281 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:52.175135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 851/1718] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:52.177217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa948c2-8c6e-423c-9c09-17074890ef51 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.177736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa948c2-8c6e-423c-9c09-17074890ef51 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.178103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa948c2-8c6e-423c-9c09-17074890ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.191662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b242e-50f0-46b7-aab5-adaa1ef9e42b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:52.194059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b242e-50f0-46b7-aab5-adaa1ef9e42b service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:52.207039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 868/1719] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:52.208806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.209305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.209761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.230596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-1fa948c2-8c6e-423c-9c09-17074890ef51 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:52.232398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:52.234552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.235434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1fa948c2-8c6e-423c-9c09-17074890ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.343012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 869/1720] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:52.344332 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:52.348728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.349822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 852/1721] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:52.351533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888bc9b-b098-47c6-8afe-97d7ba771082 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.351847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888bc9b-b098-47c6-8afe-97d7ba771082 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.352125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888bc9b-b098-47c6-8afe-97d7ba771082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.417935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a888bc9b-b098-47c6-8afe-97d7ba771082 None None] MFA Rules not processed for user `cb0d882b2ac745399a6d1e524c464676`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:52.419152 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a888bc9b-b098-47c6-8afe-97d7ba771082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.515747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0fff8-2e02-4a1a-a0df-5f3e44bd73d3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:52.520549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31afaa8-6e32-45a1-ba50-2234032d2d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:52.521180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afaa8-6e32-45a1-ba50-2234032d2d32 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.522226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afaa8-6e32-45a1-ba50-2234032d2d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.522226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afaa8-6e32-45a1-ba50-2234032d2d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.544545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:52.555681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:52.632250 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 853/1722] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:52.639689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140675-94b7-4847-9177-684dafd6bce8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.639994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140675-94b7-4847-9177-684dafd6bce8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.640271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140675-94b7-4847-9177-684dafd6bce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.727485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-de140675-94b7-4847-9177-684dafd6bce8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:52.728855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-de140675-94b7-4847-9177-684dafd6bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.753613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31afaa8-6e32-45a1-ba50-2234032d2d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:52.755152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31afaa8-6e32-45a1-ba50-2234032d2d32 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:52.767676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 854/1723] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:52.767897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140675-94b7-4847-9177-684dafd6bce8 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:52.800640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 870/1724] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:52.802608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f47ca-63b5-4d6c-b639-2b047bc8af86 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.802608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f47ca-63b5-4d6c-b639-2b047bc8af86 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.802808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f47ca-63b5-4d6c-b639-2b047bc8af86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.806227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140675-94b7-4847-9177-684dafd6bce8 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:52.821525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:52.822162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.822443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.822709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.823365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:52.823664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:52.825524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:52.862168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a91f47ca-63b5-4d6c-b639-2b047bc8af86 None None] MFA Rules not processed for user `cb0d882b2ac745399a6d1e524c464676`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:52.862872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a91f47ca-63b5-4d6c-b639-2b047bc8af86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:52.869532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 855/1725] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:52.869532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:52.898977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 871/1726] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:52.899955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f47ca-63b5-4d6c-b639-2b047bc8af86 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:52.907928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299360e2-0589-4198-a334-5c0c072283cc admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:52.929317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:52.930839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.931123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.931562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.932263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:58:52.932632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:52.934463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f47ca-63b5-4d6c-b639-2b047bc8af86 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:52.936754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:52.956499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:52.957111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:52.957388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:52.957661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:52.958302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:52.960313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:52.980475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 856/1727] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:58:52.981606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:53.059812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 872/1728] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:52 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:53.061022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ace55-1c28-4c3f-a2d8-34c11f9a7e8e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:53.063271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:53.238860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:53.239642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.240619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.240915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.245692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724c743-b20f-47b1-b8d6-de8a091d9173 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:53.253245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:53.254176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.254677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.255151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.256029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:53.258390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:53.331294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 873/1729] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:53 2022] POST /identity/v3/projects => generated 405 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:53.332409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:53.335282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:53.384363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:53.388014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:53.416441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 857/1730] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:53.416441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:53.454431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2edac-c09c-49cd-a819-8ccf03a6fffa service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:53.466906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108a41e-1b96-4b9f-af7d-2ffa82cb44bc admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:53.476345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e825-879f-45e9-bbb3-fd581a2a935f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:53.476987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e825-879f-45e9-bbb3-fd581a2a935f service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.478349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e825-879f-45e9-bbb3-fd581a2a935f service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.478625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e825-879f-45e9-bbb3-fd581a2a935f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.483759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bb75e825-879f-45e9-bbb3-fd581a2a935f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:53.522855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:53.568952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:53.593009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a63652-b300-411a-9ac1-49a5d000f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:53.593652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a63652-b300-411a-9ac1-49a5d000f3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.593938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a63652-b300-411a-9ac1-49a5d000f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.595925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a63652-b300-411a-9ac1-49a5d000f3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.598186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a63652-b300-411a-9ac1-49a5d000f3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:53.600209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a63652-b300-411a-9ac1-49a5d000f3b6 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:53.624915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e825-879f-45e9-bbb3-fd581a2a935f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:53.627753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e825-879f-45e9-bbb3-fd581a2a935f service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:53.651592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 858/1731] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:53 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:53.653902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d7f7-d3e5-401e-8f47-727f68f97f60 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.655499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d7f7-d3e5-401e-8f47-727f68f97f60 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.655806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d7f7-d3e5-401e-8f47-727f68f97f60 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.657554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 874/1732] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:53.659741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47513aab-4c95-4d20-bb1b-af5ee6598d7b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.660032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47513aab-4c95-4d20-bb1b-af5ee6598d7b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.660301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47513aab-4c95-4d20-bb1b-af5ee6598d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.662339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 859/1733] 10.222.0.42 () {54 vars in 912 bytes} [Thu Sep 15 12:58:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:58:53.663394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d7f7-d3e5-401e-8f47-727f68f97f60 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:53.695184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d7f7-d3e5-401e-8f47-727f68f97f60 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:53.709202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:53.709831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.710114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.710595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.711022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:53.722485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:53.738982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-47513aab-4c95-4d20-bb1b-af5ee6598d7b None None] MFA Rules not processed for user `e270bd406d644bf89649f40f66166430`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:53.749182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-47513aab-4c95-4d20-bb1b-af5ee6598d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:53.789673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 860/1734] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:53 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:53.793951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:53.823522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbe95a-8d47-4953-9237-a1a707c2db50 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:53.845194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05161906-e6ef-431b-b64f-45e9d93f67e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:53.848122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05161906-e6ef-431b-b64f-45e9d93f67e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.849978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05161906-e6ef-431b-b64f-45e9d93f67e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.850102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05161906-e6ef-431b-b64f-45e9d93f67e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:53.853109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05161906-e6ef-431b-b64f-45e9d93f67e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:53.859279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05161906-e6ef-431b-b64f-45e9d93f67e2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:53.911976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 861/1735] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:53.919478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf41b0-4220-4be8-a6f1-215b7424ef43 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:53.921175 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf41b0-4220-4be8-a6f1-215b7424ef43 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:53.921458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf41b0-4220-4be8-a6f1-215b7424ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.041915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 875/1736] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:54.054484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47513aab-4c95-4d20-bb1b-af5ee6598d7b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.077342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2fcf41b0-4220-4be8-a6f1-215b7424ef43 None None] MFA Rules not processed for user `3a022b80e5eb460b92e4e99728b22770`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:54.081470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2fcf41b0-4220-4be8-a6f1-215b7424ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:54.083458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47513aab-4c95-4d20-bb1b-af5ee6598d7b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.098218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.099105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.100535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.100958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.101755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.121383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.146010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 876/1737] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:54.153523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.168566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a81fae-ba64-459e-9e8f-96cd3e48c857 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.190721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.191816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.192280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.193642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.194662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.196563 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.217472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 877/1738] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:54.219293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.236954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 862/1739] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 12:58:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:54.254483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5f35-1eea-4225-acf7-0aa9b250c17f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.255084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf41b0-4220-4be8-a6f1-215b7424ef43 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.265495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.266139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.266410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.266669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.267309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.276366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.285447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf41b0-4220-4be8-a6f1-215b7424ef43 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.301891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.302869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.303307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.303897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] PATH_INFO: `/v3/projects/4299c61375294fbf93d25248a45c4379/users/7d357e2e53ad42be9c888ffd4bffb37d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.304348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 878/1740] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:54.308637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.332663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb5ca8-5c27-49a1-a04c-734c2181e569 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.339031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4299c61375294fbf93d25248a45c4379, user_id=7d357e2e53ad42be9c888ffd4bffb37d, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.345381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13694e5-497c-4f0a-ba17-cf6bb59d3879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.346066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13694e5-497c-4f0a-ba17-cf6bb59d3879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.346170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.346716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13694e5-497c-4f0a-ba17-cf6bb59d3879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.346954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13694e5-497c-4f0a-ba17-cf6bb59d3879 admin admin] PATH_INFO: `/v3/projects/e186046ef3524181b66b2150505983be/users/fd755425f09846878ad153fb0df4edda/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.380833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 863/1741] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:54 2022] PUT /identity/v3/projects/4299c61375294fbf93d25248a45c4379/users/7d357e2e53ad42be9c888ffd4bffb37d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:54.383635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.392950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:54.404258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13694e5-497c-4f0a-ba17-cf6bb59d3879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e186046ef3524181b66b2150505983be, user_id=fd755425f09846878ad153fb0df4edda, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.416564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13694e5-497c-4f0a-ba17-cf6bb59d3879 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.464238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 879/1742] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:54 2022] PUT /identity/v3/projects/e186046ef3524181b66b2150505983be/users/fd755425f09846878ad153fb0df4edda/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:58:54.469929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e3dc2-8be9-4fff-9045-50d436d35997 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.470285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e3dc2-8be9-4fff-9045-50d436d35997 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.470481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e3dc2-8be9-4fff-9045-50d436d35997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.549436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e810f59-42df-4afc-a6b0-680de446468b admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.550574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-694e3dc2-8be9-4fff-9045-50d436d35997 None None] MFA Rules not processed for user `7d357e2e53ad42be9c888ffd4bffb37d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:54.551865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-694e3dc2-8be9-4fff-9045-50d436d35997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:54.597994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:54.612659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ad50a-e433-4f32-a51b-2e5cd85abcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.613496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ad50a-e433-4f32-a51b-2e5cd85abcfe service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.613846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ad50a-e433-4f32-a51b-2e5cd85abcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.614211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ad50a-e433-4f32-a51b-2e5cd85abcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.624953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ad50a-e433-4f32-a51b-2e5cd85abcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.627118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ad50a-e433-4f32-a51b-2e5cd85abcfe service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.638055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 864/1743] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:54.639488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a496-05d5-4a55-b118-dddf9208d50a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.640027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a496-05d5-4a55-b118-dddf9208d50a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.640371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644a496-05d5-4a55-b118-dddf9208d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.661386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:54.661992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b644a496-05d5-4a55-b118-dddf9208d50a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:54.663282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b644a496-05d5-4a55-b118-dddf9208d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:54.705472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 880/1744] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:54.711147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789dcc4-36af-4a96-9793-166f89d3f597 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.711616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789dcc4-36af-4a96-9793-166f89d3f597 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.712066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789dcc4-36af-4a96-9793-166f89d3f597 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.713688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 881/1745] 10.222.0.42 () {54 vars in 912 bytes} [Thu Sep 15 12:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:58:54.716999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789dcc4-36af-4a96-9793-166f89d3f597 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.764324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 865/1746] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:54.766701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.767872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.768333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.797407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] MFA Rules not processed for user `3a022b80e5eb460b92e4e99728b22770`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:54.798808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:54.807074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 866/1747] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 12:58:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:54.808278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.813183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:54.828923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b610f6-c912-4d10-aad9-fe68e1e14ac9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.848018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.848668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.848949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.849790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.881395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.884491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.898350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789dcc4-36af-4a96-9793-166f89d3f597 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.910641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 867/1748] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:54.911455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:54.927613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.929767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.930911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.930911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.931216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.932690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca55bef-cb38-40ac-9c6e-c0d199f826e3 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:54.934364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.942432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:54.943085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:54.943352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:54.943620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:54.965903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:54.967395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:54.983831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 868/1749] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:55.041386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:55.041877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 882/1750] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:54 2022] POST /identity/v3/projects => generated 383 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:55.061194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac713ec-61bb-4597-8a97-6331735b347a service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:55.181237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:55.181867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:55.182149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:55.182395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:55.183120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:55.185238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:55.247002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 869/1751] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:55 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:58:55.249769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:55.266131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5464-e03d-4908-b4ef-af16472727e7 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:55.276832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:55.282424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:55.282699 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:55.283012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:55.285997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:55.290668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:55.349431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 883/1752] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:55.350091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:55.369597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b2a52-523f-4c5a-9377-8cd9a292760c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:55.391481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:55.392301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:55.392972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:55.393063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] PATH_INFO: `/v3/projects/40430079383944f6827d01b7db71dc56/users/fd3ce7cc0efd4b718569ae82f8c5e54b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:55.433187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=40430079383944f6827d01b7db71dc56, user_id=fd3ce7cc0efd4b718569ae82f8c5e54b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:55.443636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:55.466897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 870/1753] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:55 2022] PUT /identity/v3/projects/40430079383944f6827d01b7db71dc56/users/fd3ce7cc0efd4b718569ae82f8c5e54b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:58:55.468393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:55.486687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07047c78-c11b-4b12-a5f5-6b41c24dd264 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:55.618056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:55.653070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:55.704885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:55.705537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:55.705810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:55.706577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:55.706856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:55.708676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:55.739742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 884/1754] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:55.739742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:55.742529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:55.883138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8a21-3f54-4f67-ad74-d747543640fe admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:55.905540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:55.906885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5c4c7-1799-4a17-ae59-d1cf70d34ee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:55.907993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5c4c7-1799-4a17-ae59-d1cf70d34ee4 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:55.909785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5c4c7-1799-4a17-ae59-d1cf70d34ee4 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:55.909785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5c4c7-1799-4a17-ae59-d1cf70d34ee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:55.939455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc15db-f042-4312-8000-c374cc7f012a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:55.963539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:55.964222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:55.964683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:55.964963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:55.973043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:56.013605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:56.015222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:56.050814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 885/1755] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:56.052069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:56.106851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6efca7-d536-4819-a16a-c64d447709ab service placement] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:56.114328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8392ab-fb78-416a-a944-60d721b9b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:56.115596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8392ab-fb78-416a-a944-60d721b9b3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:56.116162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8392ab-fb78-416a-a944-60d721b9b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:56.117226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8392ab-fb78-416a-a944-60d721b9b3dd admin admin] PATH_INFO: `/v3/projects/40430079383944f6827d01b7db71dc56/users/fd3ce7cc0efd4b718569ae82f8c5e54b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:56.119892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8392ab-fb78-416a-a944-60d721b9b3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=40430079383944f6827d01b7db71dc56, user_id=fd3ce7cc0efd4b718569ae82f8c5e54b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:56.132311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8392ab-fb78-416a-a944-60d721b9b3dd admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:56.146352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5c4c7-1799-4a17-ae59-d1cf70d34ee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:56.152444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5c4c7-1799-4a17-ae59-d1cf70d34ee4 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:56.179246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 871/1756] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:58:56.187574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 886/1757] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:56 2022] PUT /identity/v3/projects/40430079383944f6827d01b7db71dc56/users/fd3ce7cc0efd4b718569ae82f8c5e54b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:56.211332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ee75-5f8c-476c-b680-fa812b524213 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:56.213093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ee75-5f8c-476c-b680-fa812b524213 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:56.215178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ee75-5f8c-476c-b680-fa812b524213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:56.326242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b641ee75-5f8c-476c-b680-fa812b524213 None None] MFA Rules not processed for user `fd3ce7cc0efd4b718569ae82f8c5e54b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:56.330148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b641ee75-5f8c-476c-b680-fa812b524213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:56.425281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682fbaf-6964-4b50-a054-b463d2ac991b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:56.431580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682fbaf-6964-4b50-a054-b463d2ac991b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:56.432372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682fbaf-6964-4b50-a054-b463d2ac991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:56.501817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7682fbaf-6964-4b50-a054-b463d2ac991b None None] MFA Rules not processed for user `1d2b0118b29b4764bd270bdcd28c363a`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:56.504958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7682fbaf-6964-4b50-a054-b463d2ac991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:56.603733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 872/1758] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:56.619071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641ee75-5f8c-476c-b680-fa812b524213 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:56.629964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 887/1759] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:56.728899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:56.780757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641ee75-5f8c-476c-b680-fa812b524213 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:56.787503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887790a2-209d-4ec1-9791-13bc93a11fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:56.788522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887790a2-209d-4ec1-9791-13bc93a11fba service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:56.789119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887790a2-209d-4ec1-9791-13bc93a11fba service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:56.789582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887790a2-209d-4ec1-9791-13bc93a11fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:56.808476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887790a2-209d-4ec1-9791-13bc93a11fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:56.810051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887790a2-209d-4ec1-9791-13bc93a11fba service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:56.841410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 873/1760] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:56.944571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682fbaf-6964-4b50-a054-b463d2ac991b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:57.085293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682fbaf-6964-4b50-a054-b463d2ac991b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:57.094839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:57.095880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:57.096763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:57.098456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] PATH_INFO: `/v3/users/7d357e2e53ad42be9c888ffd4bffb37d` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:57.100526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d357e2e53ad42be9c888ffd4bffb37d)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:57.105782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:57.255948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d357e2e53ad42be9c888ffd4bffb37d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:57.299658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d357e2e53ad42be9c888ffd4bffb37d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:57.323815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d357e2e53ad42be9c888ffd4bffb37d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:57.325110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d357e2e53ad42be9c888ffd4bffb37d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:57.349307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:57.353681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cbe9c4f4-c60c-416c-8085-84c43052e529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d357e2e53ad42be9c888ffd4bffb37d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:58:57.404183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 888/1761] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:58:56 2022] DELETE /identity/v3/users/7d357e2e53ad42be9c888ffd4bffb37d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:57.406006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:57.407016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:57.407626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:57.472454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:57.476020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:57.586355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8b86-0f79-4372-bb9a-07659fc044c8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:57.587186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8b86-0f79-4372-bb9a-07659fc044c8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:57.587600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8b86-0f79-4372-bb9a-07659fc044c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:57.618153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9ada8b86-0f79-4372-bb9a-07659fc044c8 None None] MFA Rules not processed for user `cb0d882b2ac745399a6d1e524c464676`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:57.619910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9ada8b86-0f79-4372-bb9a-07659fc044c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:57.787588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 874/1762] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:57.803854 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 889/1763] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:58:57.852896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:57.855716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:58.186262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c492f-b546-4254-b111-895ea81f5cb7 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:58.186262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:58.186262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:58.186262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:58.186772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:58.188339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27fd8-15da-4e62-8d56-0b70e0155ee3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:58.188818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27fd8-15da-4e62-8d56-0b70e0155ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:58.189535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27fd8-15da-4e62-8d56-0b70e0155ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:58.230099 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:58.242592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:58.291681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 875/1764] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:58:58.309949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c7c27fd8-15da-4e62-8d56-0b70e0155ee3 None None] MFA Rules not processed for user `fd755425f09846878ad153fb0df4edda`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:58:58.311457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c7c27fd8-15da-4e62-8d56-0b70e0155ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:58.558924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 890/1765] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:58:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:58:58.563151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:58.564698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:58:58.599502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399acb9-2c96-4ef7-a965-9cee925927c7 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:58.635756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:58.636553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:58.636913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:58.637128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:58.637770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:58.647234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:58.781924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 876/1766] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:58:58 2022] POST /identity/v3/projects => generated 405 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:58:58.786567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27fd8-15da-4e62-8d56-0b70e0155ee3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:58.810799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27fd8-15da-4e62-8d56-0b70e0155ee3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:59.056877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:59.060606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:59.062386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:59.063919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:59.064851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:59.087010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:59.181774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 891/1767] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:58:58 2022] POST /identity/v3/users => generated 309 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:58:59.186172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:59.214597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a988de-f8f4-4e18-ba20-7ae3b432bd9f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:59.253013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:59.254279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:59.256133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:59.257707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:59.263241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:59.267446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:59.322987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:59.336563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 877/1768] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:58:59.344288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458e10-6f78-439e-9e2d-dbf1ba51ded2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:59.377662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:59.381349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:59.381764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:59.383576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] PATH_INFO: `/v3/projects/3dcb9b05cca24ae68a641f9eb068bd58/users/dfa330df6c4b44b1a0c241198ff9ae02/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:59.442308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcb9b05cca24ae68a641f9eb068bd58, user_id=dfa330df6c4b44b1a0c241198ff9ae02, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:59.457951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:59.460118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:59.487331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 892/1769] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:59 2022] PUT /identity/v3/projects/3dcb9b05cca24ae68a641f9eb068bd58/users/dfa330df6c4b44b1a0c241198ff9ae02/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:59.491285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:59.519721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda3c5d-3992-4057-97cd-c1acbf260a4d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:59.647827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:58:59.676428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:59.677694 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:59.681865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:59.682294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:59.683138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:59.686665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:59.723322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 878/1770] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:58:59.727460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:59.745226 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c587e27-b2c2-4fe5-bac6-5d9a2986d111 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:58:59.762024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:58:59.767251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:58:59.768196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:58:59.769368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] PATH_INFO: `/v3/projects/3dcb9b05cca24ae68a641f9eb068bd58/users/dfa330df6c4b44b1a0c241198ff9ae02/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:58:59.779377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcb9b05cca24ae68a641f9eb068bd58, user_id=dfa330df6c4b44b1a0c241198ff9ae02, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:58:59.795472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:58:59.831779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 893/1771] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:58:59 2022] PUT /identity/v3/projects/3dcb9b05cca24ae68a641f9eb068bd58/users/dfa330df6c4b44b1a0c241198ff9ae02/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:58:59.983188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:58:59.997096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:00.084258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0580d4-9c60-494c-b4f7-22d72b313c04 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:00.301959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:00.302809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:00.303027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:00.304346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] PATH_INFO: `/v3/projects/4299c61375294fbf93d25248a45c4379` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:00.308212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4299c61375294fbf93d25248a45c4379)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:00.314183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:00.479404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4299c61375294fbf93d25248a45c4379', 'request_id': 'req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:00.497640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4299c61375294fbf93d25248a45c4379', 'request_id': 'req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:00.513451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4299c61375294fbf93d25248a45c4379', 'request_id': 'req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:00.539912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] The token cache is being invalidate because project 4299c61375294fbf93d25248a45c4379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:00.541757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:00.544410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fe54281b-42c1-4c1e-942f-1126dc7dc5a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:00.547919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 879/1772] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:58:59 2022] DELETE /identity/v3/projects/4299c61375294fbf93d25248a45c4379 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:00.552021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:00.554683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:00.582060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9cd32-08c3-4bd6-8173-c976077563e9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:00.794930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:00.795901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:00.797537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:00.797961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] PATH_INFO: `/v3/users/fd3ce7cc0efd4b718569ae82f8c5e54b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:00.801067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3ce7cc0efd4b718569ae82f8c5e54b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:00.803455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:00.942071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3ce7cc0efd4b718569ae82f8c5e54b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:00.969874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3ce7cc0efd4b718569ae82f8c5e54b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:01.010894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3ce7cc0efd4b718569ae82f8c5e54b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:01.018194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3ce7cc0efd4b718569ae82f8c5e54b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:01.077659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3ce7cc0efd4b718569ae82f8c5e54b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:01.111640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 894/1773] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:00 2022] DELETE /identity/v3/users/fd3ce7cc0efd4b718569ae82f8c5e54b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:01.317430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:01.318286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:01.318733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:01.610214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:01.611534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:01.837196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:01.944196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 880/1774] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 12:59:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 627 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:02.248253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:02.250504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:02.421003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:02.533113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42b43-cf3b-4298-85c5-ded2b5f1fa3f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:02.546074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:02.548162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:02.550046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:02.550440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:02.578801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:02.581654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:02.594592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 895/1775] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 12:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:59:04.143347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:04.144804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:04.157376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:04.159597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:04.392934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2184ed2-f289-4393-9c9f-96d987b5136c service swift] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:04.412468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:04.413310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:04.413698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:04.414077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] PATH_INFO: `/v3/users/276ffe3374f642de833b956ba41049b1` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:04.415407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276ffe3374f642de833b956ba41049b1)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:04.418582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:04.427525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb2dec-d513-4d0e-b412-dca5897a9cd8 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:04.458655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:04.464248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:04.464587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:04.464877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] PATH_INFO: `/v3/projects/40430079383944f6827d01b7db71dc56` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:04.472182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40430079383944f6827d01b7db71dc56)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:04.492888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:04.601994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276ffe3374f642de833b956ba41049b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.641310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276ffe3374f642de833b956ba41049b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.676155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276ffe3374f642de833b956ba41049b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.696434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276ffe3374f642de833b956ba41049b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.730639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40430079383944f6827d01b7db71dc56', 'request_id': 'req-13be5bc0-8469-40f3-aaa2-923f6b622bb2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.744731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40430079383944f6827d01b7db71dc56', 'request_id': 'req-13be5bc0-8469-40f3-aaa2-923f6b622bb2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.752921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00d20900-99af-46ef-a2ea-7295ac998b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276ffe3374f642de833b956ba41049b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.754189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40430079383944f6827d01b7db71dc56', 'request_id': 'req-13be5bc0-8469-40f3-aaa2-923f6b622bb2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.780156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 896/1776] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:04 2022] DELETE /identity/v3/users/276ffe3374f642de833b956ba41049b1 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:04.785088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56106959-9b9d-4499-8ab8-1984d00022e3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:04.785370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56106959-9b9d-4499-8ab8-1984d00022e3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:04.785645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56106959-9b9d-4499-8ab8-1984d00022e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:04.831944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] The token cache is being invalidate because project 40430079383944f6827d01b7db71dc56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:04.832897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.835634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13be5bc0-8469-40f3-aaa2-923f6b622bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:04.840226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 881/1777] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:04 2022] DELETE /identity/v3/projects/40430079383944f6827d01b7db71dc56 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:04.862581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3e36a-a2e7-4ca0-a4b0-a391228af6a2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:04.863878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3e36a-a2e7-4ca0-a4b0-a391228af6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:04.864168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3e36a-a2e7-4ca0-a4b0-a391228af6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:04.885174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-56106959-9b9d-4499-8ab8-1984d00022e3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:04.886764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-56106959-9b9d-4499-8ab8-1984d00022e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:04.957468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b3b3e36a-a2e7-4ca0-a4b0-a391228af6a2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:04.959067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b3b3e36a-a2e7-4ca0-a4b0-a391228af6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:05.082228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:05.148196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 897/1778] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:05.153877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febf86-1089-4bc6-aa49-b5ed9cae551b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:05.154192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febf86-1089-4bc6-aa49-b5ed9cae551b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:05.154760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febf86-1089-4bc6-aa49-b5ed9cae551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:05.195495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 882/1779] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:05.207835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:05.209776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:05.212880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:05.218069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-21febf86-1089-4bc6-aa49-b5ed9cae551b None None] MFA Rules not processed for user `3a022b80e5eb460b92e4e99728b22770`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:05.219309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-21febf86-1089-4bc6-aa49-b5ed9cae551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:05.337870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:05.341228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:05.366549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 883/1780] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:05.367597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:05.372050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 898/1781] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Sep 15 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:05.372338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:05.372967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21febf86-1089-4bc6-aa49-b5ed9cae551b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:05.404867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8661-3fe3-49ea-bc71-704bbc34d5aa None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:05.411140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:05.412877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:05.413383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:05.413741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:05.426918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:05.428139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21febf86-1089-4bc6-aa49-b5ed9cae551b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:05.428884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:05.443449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:05.452944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 884/1782] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:05.468782 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:05.475600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:05.475600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:05.475600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:05.475600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:05.476134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:05.476134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:05.481813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:05.484554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bfd29-0131-40fe-a7b7-242e9921e62c service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:05.514018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:05.516085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 899/1783] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:05.520331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:05.528870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:05.529318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:05.530216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:05.549357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:05.550985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:05.558609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c2b3f-1042-45fa-aefc-ec455a6aa9bc admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:05.573253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:05.574085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:05.574477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:05.574756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:05.575403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:05.581564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 885/1784] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:05.585781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:05.663427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 900/1785] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:05 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:05.668590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:05.697490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f986-1e9b-4057-8b77-848fa85a254c service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:05.869542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc1b3a-66fc-44d3-81f4-e2af9c8ed81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:05.872214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc1b3a-66fc-44d3-81f4-e2af9c8ed81f admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:05.872498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc1b3a-66fc-44d3-81f4-e2af9c8ed81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:05.874173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc1b3a-66fc-44d3-81f4-e2af9c8ed81f admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:05.875943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc1b3a-66fc-44d3-81f4-e2af9c8ed81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:05.877975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc1b3a-66fc-44d3-81f4-e2af9c8ed81f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:05.934352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 886/1786] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:05 2022] POST /identity/v3/users => generated 283 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:05.941020 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:05.981481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b445079-f180-49b6-b0a0-7e265f35a46e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:06.016851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:06.017985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:06.018763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:06.019150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:06.021493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:06.035309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:06.055726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee8b9-d0ca-4b4e-8144-6c7d34625a2f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:06.056192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee8b9-d0ca-4b4e-8144-6c7d34625a2f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:06.057236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ee8b9-d0ca-4b4e-8144-6c7d34625a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:06.091494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 901/1787] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:06.094413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:06.129008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16cf9-df38-4411-812d-e3291af3e919 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:06.158081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:06.159501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:06.160492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-418ee8b9-d0ca-4b4e-8144-6c7d34625a2f None None] MFA Rules not processed for user `dfa330df6c4b44b1a0c241198ff9ae02`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:06.162940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:06.164819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:06.166123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:06.169386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-418ee8b9-d0ca-4b4e-8144-6c7d34625a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:06.174242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:06.211430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 902/1788] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:06.212883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:06.235294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a25c-1a70-4fe3-844c-77e37e0e6f64 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:06.262063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a875a65-ca23-4c50-ac2c-05200bba120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:06.265140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875a65-ca23-4c50-ac2c-05200bba120c admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:06.268328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875a65-ca23-4c50-ac2c-05200bba120c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:06.268924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875a65-ca23-4c50-ac2c-05200bba120c admin admin] PATH_INFO: `/v3/projects/bc3ccf676e2d4935a70f2a4e4cff64e4/users/5683b9aab16048bfb0028862874c9eb4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:06.312784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a875a65-ca23-4c50-ac2c-05200bba120c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3ccf676e2d4935a70f2a4e4cff64e4, user_id=5683b9aab16048bfb0028862874c9eb4, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:06.318621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a875a65-ca23-4c50-ac2c-05200bba120c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:06.352094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 903/1789] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:06 2022] PUT /identity/v3/projects/bc3ccf676e2d4935a70f2a4e4cff64e4/users/5683b9aab16048bfb0028862874c9eb4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:06.365240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77045cd-2a42-46d4-bef3-7df08cdf9153 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:06.365769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77045cd-2a42-46d4-bef3-7df08cdf9153 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:06.366401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77045cd-2a42-46d4-bef3-7df08cdf9153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:06.368783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 887/1790] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:06.434828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f77045cd-2a42-46d4-bef3-7df08cdf9153 None None] MFA Rules not processed for user `5683b9aab16048bfb0028862874c9eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:06.438088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f77045cd-2a42-46d4-bef3-7df08cdf9153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:06.605220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 904/1791] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:06.612228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ee8b9-d0ca-4b4e-8144-6c7d34625a2f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:06.658313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ee8b9-d0ca-4b4e-8144-6c7d34625a2f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:06.797105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:06.797753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:06.798032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:06.798413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:06.801445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:06.804804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:06.829349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:06.869275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 888/1792] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:06 2022] POST /identity/v3/projects => generated 367 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:06.872894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77045cd-2a42-46d4-bef3-7df08cdf9153 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:06.890256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:06.915725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77045cd-2a42-46d4-bef3-7df08cdf9153 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:07.055259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3da96-158d-48cb-9ac4-1a6e2d20874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:07.055958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3da96-158d-48cb-9ac4-1a6e2d20874c admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.056322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3da96-158d-48cb-9ac4-1a6e2d20874c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.056507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3da96-158d-48cb-9ac4-1a6e2d20874c admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.058329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3da96-158d-48cb-9ac4-1a6e2d20874c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:07.063631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3da96-158d-48cb-9ac4-1a6e2d20874c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:07.148557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 905/1793] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:06 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:07.153198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:07.171849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658d2f7-a9cd-43b0-bdbe-8be319ca310e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:07.196154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:07.196843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.197102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.197380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.204467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:07.210104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:07.237294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.237836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.237836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.264652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 889/1794] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:07.275312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:07.312892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] MFA Rules not processed for user `e270bd406d644bf89649f40f66166430`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:07.315328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:07.324489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392b0ea-5055-4238-83da-e9f26ac1c706 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:07.337359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:07.339895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.342092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.342604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] PATH_INFO: `/v3/projects/65830a59d3bb4fd687030ecb64cb57af/users/889b56e5d0ce43e4839062a617ed06d1/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.378186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=65830a59d3bb4fd687030ecb64cb57af, user_id=889b56e5d0ce43e4839062a617ed06d1, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:07.382517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:07.409634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 890/1795] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:07 2022] PUT /identity/v3/projects/65830a59d3bb4fd687030ecb64cb57af/users/889b56e5d0ce43e4839062a617ed06d1/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:07.414965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:07.506864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 906/1796] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:07.579665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba78d5-0c6d-4cda-b49e-a52cdf08f0ec admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:07.585337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:07.586743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:07.603227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:07.603934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.617339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.617765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.618796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:07.640852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:07.655173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccad6e9-9f00-473f-9a08-69aa1f87734c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:07.671957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:07.672903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.673286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.673635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] PATH_INFO: `/v3/users/9f95766d7b8445dd8d21142ad1cab05c` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.674736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 891/1797] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:07.675688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:07.676978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f95766d7b8445dd8d21142ad1cab05c)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:07.679306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:07.709059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751a82f-9fe9-4e20-80b2-cc5e5895c6fa admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:07.740925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d0ac4-e239-4d07-b60f-0c95a84824ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:07.741997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d0ac4-e239-4d07-b60f-0c95a84824ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.742473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d0ac4-e239-4d07-b60f-0c95a84824ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.742908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d0ac4-e239-4d07-b60f-0c95a84824ba admin admin] PATH_INFO: `/v3/projects/65830a59d3bb4fd687030ecb64cb57af/users/889b56e5d0ce43e4839062a617ed06d1/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.753414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d0ac4-e239-4d07-b60f-0c95a84824ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=65830a59d3bb4fd687030ecb64cb57af, user_id=889b56e5d0ce43e4839062a617ed06d1, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:07.766016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d0ac4-e239-4d07-b60f-0c95a84824ba admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:07.827351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 892/1798] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:07 2022] PUT /identity/v3/projects/65830a59d3bb4fd687030ecb64cb57af/users/889b56e5d0ce43e4839062a617ed06d1/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:07.830040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.833097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.834646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f95766d7b8445dd8d21142ad1cab05c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:07.835129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.854167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f95766d7b8445dd8d21142ad1cab05c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:07.871997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f95766d7b8445dd8d21142ad1cab05c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:07.873714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f95766d7b8445dd8d21142ad1cab05c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:07.909117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1db5efb3-bf06-4a32-970f-a62cd286d823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f95766d7b8445dd8d21142ad1cab05c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:07.919217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] MFA Rules not processed for user `889b56e5d0ce43e4839062a617ed06d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:07.923374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:07.926147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 907/1799] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:07 2022] DELETE /identity/v3/users/9f95766d7b8445dd8d21142ad1cab05c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:07.927684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:07.929445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:07.929775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:07.976182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:07.978992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:07.991131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:08.123591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 908/1800] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:08.138676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 893/1801] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:08.159039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:08.160992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:08.335095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:08.336820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:08.354165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f7ad2-fc7a-4c44-b61e-6b7a4e4d9019 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:08.368652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:08.369267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:08.369546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:08.369809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:08.409228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:08.409807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:08.418639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:08.465784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 909/1802] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:08.567217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8fef-d3b2-4575-b22b-e0c16c757729 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:08.584626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:08.585574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:08.586549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:08.586989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:08.609858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:08.611864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:08.652995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 894/1803] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:08.686040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:08.697479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5ad8a-205c-437d-ae72-61923433ef8d service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:08.712044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:08.712870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:08.713149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:08.713418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:08.718621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:08.862973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:08.865077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:08.885252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 910/1804] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:09.490883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:09.492653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:09.517993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d2c2-a3e7-4ad7-8d17-685500bbd035 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:09.538672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:09.539366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:09.539673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:09.540003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] PATH_INFO: `/v3/projects/c0a33f7f963e44dc9f5dadff60458593` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:09.544473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a33f7f963e44dc9f5dadff60458593)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:09.546410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:09.685945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a33f7f963e44dc9f5dadff60458593', 'request_id': 'req-8440010e-1eee-4e23-93f8-cbf0b6fb4571'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:09.702246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a33f7f963e44dc9f5dadff60458593', 'request_id': 'req-8440010e-1eee-4e23-93f8-cbf0b6fb4571'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:09.710344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a33f7f963e44dc9f5dadff60458593', 'request_id': 'req-8440010e-1eee-4e23-93f8-cbf0b6fb4571'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:09.732941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] The token cache is being invalidate because project c0a33f7f963e44dc9f5dadff60458593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:09.733254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:09.734181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8440010e-1eee-4e23-93f8-cbf0b6fb4571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:09.739412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 895/1805] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:09 2022] DELETE /identity/v3/projects/c0a33f7f963e44dc9f5dadff60458593 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:09.741058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:09.759807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf13161-5a0f-4ba9-b98e-3342ea570af3 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:09.940417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:09.959725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:09.962495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:09.962777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:09.963361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] PATH_INFO: `/v3/users/88b604ae50c04c348a48996cee655944` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:09.973548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b604ae50c04c348a48996cee655944)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:09.978110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:10.130841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b604ae50c04c348a48996cee655944'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:10.146508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b604ae50c04c348a48996cee655944'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:10.166295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b604ae50c04c348a48996cee655944'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:10.168116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b604ae50c04c348a48996cee655944'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:10.202544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-beee928a-a11f-418c-b6b8-ed689847f2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b604ae50c04c348a48996cee655944'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:10.216541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 911/1806] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:09 2022] DELETE /identity/v3/users/88b604ae50c04c348a48996cee655944 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:10.363189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b71d-707e-44e5-806c-0a11b9f31dd5 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:10.363528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b71d-707e-44e5-806c-0a11b9f31dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:10.363757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b71d-707e-44e5-806c-0a11b9f31dd5 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:10.365228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 896/1807] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:59:10.448492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce102f-eea8-4ddc-867e-4e8014a36033 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:10.448813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce102f-eea8-4ddc-867e-4e8014a36033 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:10.449025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce102f-eea8-4ddc-867e-4e8014a36033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:10.512842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a4ce102f-eea8-4ddc-867e-4e8014a36033 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:10.525793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a4ce102f-eea8-4ddc-867e-4e8014a36033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:10.839929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 912/1808] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:59:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:11.243983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a609cb-c8b6-41a0-98b8-cdcff21e145a None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:11.244611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a609cb-c8b6-41a0-98b8-cdcff21e145a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:11.244611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a609cb-c8b6-41a0-98b8-cdcff21e145a None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:11.246900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 897/1809] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:59:11.289787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca92a2-c696-442b-8997-7483119d37a8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:11.290089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca92a2-c696-442b-8997-7483119d37a8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:11.290550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca92a2-c696-442b-8997-7483119d37a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:11.342320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a2ca92a2-c696-442b-8997-7483119d37a8 None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:11.343973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a2ca92a2-c696-442b-8997-7483119d37a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:11.388469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a609cb-c8b6-41a0-98b8-cdcff21e145a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:11.390973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d7a609cb-c8b6-41a0-98b8-cdcff21e145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:11.560283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a609cb-c8b6-41a0-98b8-cdcff21e145a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:11.573807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:11.574825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:11.575302 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:11.576090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] PATH_INFO: `/v3/projects/30626024bfee42698e9333e6f19150e2` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:11.578164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30626024bfee42698e9333e6f19150e2)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:11.582817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:11.622395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:11.660715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 913/1810] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:11.698398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:11.700673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30626024bfee42698e9333e6f19150e2', 'request_id': 'req-b2b27778-37a0-4f7e-930f-67a9d56a9848'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:11.718519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30626024bfee42698e9333e6f19150e2', 'request_id': 'req-b2b27778-37a0-4f7e-930f-67a9d56a9848'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:11.732430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30626024bfee42698e9333e6f19150e2', 'request_id': 'req-b2b27778-37a0-4f7e-930f-67a9d56a9848'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:11.763674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] The token cache is being invalidate because project 30626024bfee42698e9333e6f19150e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:11.764826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:11.768106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b2b27778-37a0-4f7e-930f-67a9d56a9848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:11.772797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 898/1811] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:11 2022] DELETE /identity/v3/projects/30626024bfee42698e9333e6f19150e2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:11.779130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349a50c-d4bc-4333-b9bf-4758d6564487 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:11.779454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349a50c-d4bc-4333-b9bf-4758d6564487 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:11.779848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349a50c-d4bc-4333-b9bf-4758d6564487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:11.831295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7349a50c-d4bc-4333-b9bf-4758d6564487 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:11.836816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7349a50c-d4bc-4333-b9bf-4758d6564487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:11.846430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc804c-5943-4d6c-9754-0303a4cf9a8c None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:11.846711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc804c-5943-4d6c-9754-0303a4cf9a8c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:11.846978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc804c-5943-4d6c-9754-0303a4cf9a8c None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:11.849690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 899/1812] 10.222.0.42 () {54 vars in 961 bytes} [Thu Sep 15 12:59:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:59:11.861261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438707f-c262-4350-957c-afc19d899c6d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:11.861543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438707f-c262-4350-957c-afc19d899c6d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:11.861810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438707f-c262-4350-957c-afc19d899c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:11.892897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2438707f-c262-4350-957c-afc19d899c6d None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:11.894299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2438707f-c262-4350-957c-afc19d899c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:12.023323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 900/1813] 10.222.0.42 () {58 vars in 1058 bytes} [Thu Sep 15 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:12.034556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438707f-c262-4350-957c-afc19d899c6d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:12.051465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 914/1814] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:12.052014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438707f-c262-4350-957c-afc19d899c6d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:12.061786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec2006-821b-41f5-8281-9247c09802ee None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:12.063675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:12.064257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:12.064454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec2006-821b-41f5-8281-9247c09802ee None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:12.065076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec2006-821b-41f5-8281-9247c09802ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:12.067172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:12.067172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:12.084523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:12.107115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:12.120487 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:12.144375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 901/1815] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:12.188753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3cec2006-821b-41f5-8281-9247c09802ee None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:12.190464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3cec2006-821b-41f5-8281-9247c09802ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:12.217733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 915/1816] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:12.219925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:12.246130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0163441-80a8-49e2-aed2-d83e1d309d0b service placement] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:12.296736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:12.297959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:12.307722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:12.308828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:12.312197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:12.312927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:12.315369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:12.358033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 902/1817] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:12.359896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec2006-821b-41f5-8281-9247c09802ee None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:12.388282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec2006-821b-41f5-8281-9247c09802ee None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:12.406607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:12.407444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:12.407850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:12.408214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:12.408958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:12.411016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:12.477794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 916/1818] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:12 2022] POST /identity/v3/projects => generated 357 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:12.482306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:12.497663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f609-369f-406e-a663-ec4703d833ea admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:12.634349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:12.635894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:12.636297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:12.636673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:12.637527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:12.647689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:12.708984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 903/1819] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:12 2022] POST /identity/v3/users => generated 279 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:12.711675 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:12.735902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f32c-f16b-45b2-b13f-a8bbe52541bb admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:12.739219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:12.745246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:12.777619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:12.778546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:12.780147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:12.788093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:12.790616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:12.795991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:12.846387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 917/1820] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:12.852519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:12.888673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dcccf-3546-42ee-bdf2-b2096845f418 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:12.909216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:12.910893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:12.913581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:12.915420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:12.921866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:12.923072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:12.927306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:12.980856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 918/1821] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:13.005064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:13.063388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d96cfe-a5b6-4f3f-84a7-a1aee3438e21 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:13.067131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3e8d5-109b-4c9c-a7bd-ebc883a60340 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:13.094047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:13.096592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:13.099221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:13.100587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:13.111900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:13.115127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e067d0d-a842-42b3-b639-bcb549e8b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:13.123261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e067d0d-a842-42b3-b639-bcb549e8b15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:13.124354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e067d0d-a842-42b3-b639-bcb549e8b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:13.124836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e067d0d-a842-42b3-b639-bcb549e8b15c admin admin] PATH_INFO: `/v3/projects/b02c53cc227741deb5aa314e42b58437/users/f3167d9108df4167813599957d89b88d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:13.192943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e067d0d-a842-42b3-b639-bcb549e8b15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02c53cc227741deb5aa314e42b58437, user_id=f3167d9108df4167813599957d89b88d, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:13.198712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e067d0d-a842-42b3-b639-bcb549e8b15c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:13.208166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:13.211191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:13.250105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 919/1822] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:12 2022] PUT /identity/v3/projects/b02c53cc227741deb5aa314e42b58437/users/f3167d9108df4167813599957d89b88d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:13.261077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e896a1-f60a-4d44-9263-f817e648e707 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:13.261683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e896a1-f60a-4d44-9263-f817e648e707 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:13.262103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e896a1-f60a-4d44-9263-f817e648e707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:13.288403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 904/1823] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:13.364074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a6e896a1-f60a-4d44-9263-f817e648e707 None None] MFA Rules not processed for user `f3167d9108df4167813599957d89b88d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:13.367796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a6e896a1-f60a-4d44-9263-f817e648e707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:13.406095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:13.410297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:13.466825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c013-3e74-4964-94fe-86ef176ff334 service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:13.647405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 920/1824] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:13.651348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e896a1-f60a-4d44-9263-f817e648e707 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:13.764350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:13.775186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:13.780215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:13.784899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:13.785422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] PATH_INFO: `/v3/projects/c5e66252bc9e408fa3865002609b8300` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:13.789853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e66252bc9e408fa3865002609b8300)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:13.792373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:14.003974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e66252bc9e408fa3865002609b8300', 'request_id': 'req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:14.018780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e896a1-f60a-4d44-9263-f817e648e707 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:14.057798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e66252bc9e408fa3865002609b8300', 'request_id': 'req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:14.120885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e66252bc9e408fa3865002609b8300', 'request_id': 'req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:14.173920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] The token cache is being invalidate because project c5e66252bc9e408fa3865002609b8300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:14.174229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:14.176750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6f7eeb41-1d47-4e2a-8487-6304c03eccc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:14.184572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 905/1825] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:13 2022] DELETE /identity/v3/projects/c5e66252bc9e408fa3865002609b8300 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:14.190960 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972dd79-0362-49db-b298-4d330510eff3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:14.191527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972dd79-0362-49db-b298-4d330510eff3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:14.191879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972dd79-0362-49db-b298-4d330510eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:14.255119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2972dd79-0362-49db-b298-4d330510eff3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:14.256659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2972dd79-0362-49db-b298-4d330510eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:14.306899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:14.309048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:14.310802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:14.311286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:14.313315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:14.320032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:14.407793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 921/1826] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:13 2022] POST /identity/v3/projects => generated 357 bytes in 754 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:14.408650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:14.410528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:14.413766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:14.472812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 906/1827] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:14.499356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7aca-7da0-48fd-9ca6-9390b7c10ec9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:14.504398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7aca-7da0-48fd-9ca6-9390b7c10ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:14.505621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7aca-7da0-48fd-9ca6-9390b7c10ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:14.598444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-faed7aca-7da0-48fd-9ca6-9390b7c10ec9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:14.604180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-faed7aca-7da0-48fd-9ca6-9390b7c10ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:14.677172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed84a-f07e-4f7f-8f61-7809ede5a3b5 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:14.683906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:14.684797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:14.684924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:14.685147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:14.685874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:14.688298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:14.741189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 922/1828] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:14 2022] POST /identity/v3/users => generated 285 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:14.742764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:14.767301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb846e-9ed3-4afd-8943-ff17a1cb9b6f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:14.793914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:14.794566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:14.794839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:14.795141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:14.795824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:14.798929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:14.844937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 923/1829] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:14.849025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:14.857969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 907/1830] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:14.866380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed7aca-7da0-48fd-9ca6-9390b7c10ec9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:14.889698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301729fd-49d6-4206-bfa9-8402bffce76a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:14.904085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed7aca-7da0-48fd-9ca6-9390b7c10ec9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:14.905372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:14.906057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:14.906968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:14.907282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] PATH_INFO: `/v3/projects/69c5b48631f348da8b30ac31b9463466/users/d030eb730ad94b70bae0d541ffc2c69b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:14.914641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:14.915244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:14.915472 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:14.915805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:14.916648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:14.920227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:14.924157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:14.962129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c5b48631f348da8b30ac31b9463466, user_id=d030eb730ad94b70bae0d541ffc2c69b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:14.969006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 908/1831] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:14.969357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:14.972872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:15.031917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca64b68-b1c4-4452-bd89-4bd432bbc642 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:15.035544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 924/1832] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:14 2022] PUT /identity/v3/projects/69c5b48631f348da8b30ac31b9463466/users/d030eb730ad94b70bae0d541ffc2c69b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:15.037683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:15.063772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:15.358964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:15.360991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:15.361687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:15.364159 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:15.367186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:15.375324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:15.384558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ae445-3c84-412d-8ea5-53196d820c84 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:15.400066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:15.402267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:15.402553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:15.402822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:15.409348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:15.414110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:15.460384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 909/1833] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:14 2022] POST /identity/v3/projects => generated 401 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:15.462010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:15.469547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 925/1834] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:15.473814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:15.496496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d87be-f32b-4997-8d85-881e33a06a98 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:15.651083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdb824-5a6c-4fd0-9ab5-7b114a0b5e54 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:15.655838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479932f4-c9f2-4e0e-8560-6f2d012353a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:15.656760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479932f4-c9f2-4e0e-8560-6f2d012353a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:15.657064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479932f4-c9f2-4e0e-8560-6f2d012353a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:15.657316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479932f4-c9f2-4e0e-8560-6f2d012353a3 admin admin] PATH_INFO: `/v3/projects/69c5b48631f348da8b30ac31b9463466/users/d030eb730ad94b70bae0d541ffc2c69b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:15.658260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:15.658895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:15.659307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479932f4-c9f2-4e0e-8560-6f2d012353a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c5b48631f348da8b30ac31b9463466, user_id=d030eb730ad94b70bae0d541ffc2c69b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:15.659646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:15.659971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:15.662038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479932f4-c9f2-4e0e-8560-6f2d012353a3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:15.662161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:15.664026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:15.682741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 926/1835] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:15 2022] PUT /identity/v3/projects/69c5b48631f348da8b30ac31b9463466/users/d030eb730ad94b70bae0d541ffc2c69b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:15.695942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:15.696523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:15.696523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:15.704007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:15.735319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 910/1836] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:15 2022] POST /identity/v3/users => generated 301 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:15.739319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:15.759032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] MFA Rules not processed for user `d030eb730ad94b70bae0d541ffc2c69b`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:15.760339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:15.763741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9824c6-bf57-4e14-b725-750ba0aecbd5 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:15.921981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 927/1837] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:15.938554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:15.940366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:15.997477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:15.998124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:15.998400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:15.998669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:15.999328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.001018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:16.002239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:16.059795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 911/1838] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:16.061753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:16.103612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27d75b-b28b-4bb3-8a60-319373578061 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:16.122708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:16.122708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.122949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.123229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.123872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.125648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:16.134356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b57aa-aff6-428d-9ba5-9e4b9c2b64fc None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:16.139961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a650ef6-f418-4843-aab0-3b162ab65ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:16.140683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650ef6-f418-4843-aab0-3b162ab65ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.140951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650ef6-f418-4843-aab0-3b162ab65ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.142011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a650ef6-f418-4843-aab0-3b162ab65ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.153719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 912/1839] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:16.159071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a650ef6-f418-4843-aab0-3b162ab65ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.159276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:16.160757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a650ef6-f418-4843-aab0-3b162ab65ef5 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:16.181547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d40dd-69d5-4483-bc52-653b029ec5c9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:16.184790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 928/1840] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:16.195016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:16.196345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.196873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.197387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] PATH_INFO: `/v3/projects/4d3ee8a041e643a385369584711c772b/users/23e999fd035d44af88229f9d6cc10c0c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.222369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3ee8a041e643a385369584711c772b, user_id=23e999fd035d44af88229f9d6cc10c0c, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.225376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:16.270434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 913/1841] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:16 2022] PUT /identity/v3/projects/4d3ee8a041e643a385369584711c772b/users/23e999fd035d44af88229f9d6cc10c0c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:16.283297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81de-b157-4c5b-ab40-ff5ef9c00f6d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.284524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81de-b157-4c5b-ab40-ff5ef9c00f6d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.284974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81de-b157-4c5b-ab40-ff5ef9c00f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.321785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:16.341592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2abf81de-b157-4c5b-ab40-ff5ef9c00f6d None None] MFA Rules not processed for user `23e999fd035d44af88229f9d6cc10c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:16.342911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2abf81de-b157-4c5b-ab40-ff5ef9c00f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:16.461274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 929/1842] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:16 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:16.466179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf81de-b157-4c5b-ab40-ff5ef9c00f6d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:16.484494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11402e3-552e-4047-b97b-1592ae1aef59 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:16.493186 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b4bce-e2d4-454e-b033-0748160b82c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:16.493940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b4bce-e2d4-454e-b033-0748160b82c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.494221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b4bce-e2d4-454e-b033-0748160b82c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.494546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b4bce-e2d4-454e-b033-0748160b82c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.500383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-466b4bce-e2d4-454e-b033-0748160b82c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:16.609451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf81de-b157-4c5b-ab40-ff5ef9c00f6d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:16.623528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:16.624274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.624616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.624950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.625656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.627683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:16.633533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b4bce-e2d4-454e-b033-0748160b82c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.635453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b4bce-e2d4-454e-b033-0748160b82c8 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:16.660214 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 914/1843] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:16.671676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8295-eafe-4820-adb7-1cb82293b092 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.672273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8295-eafe-4820-adb7-1cb82293b092 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.672710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e8295-eafe-4820-adb7-1cb82293b092 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.675504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 915/1844] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:59:16.686189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 930/1845] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:16 2022] POST /identity/v3/projects => generated 401 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:16.689021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e8295-eafe-4820-adb7-1cb82293b092 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:16.692812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:16.693110 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-048e8295-eafe-4820-adb7-1cb82293b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:16.713883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:16.747745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:16.788012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3847f3-514e-418d-891f-a093abfd244e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:16.801457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f35036-6624-4d33-b0ec-2a5bc5c2532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:16.802126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f35036-6624-4d33-b0ec-2a5bc5c2532b admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.802463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f35036-6624-4d33-b0ec-2a5bc5c2532b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.802765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f35036-6624-4d33-b0ec-2a5bc5c2532b admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.803438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f35036-6624-4d33-b0ec-2a5bc5c2532b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.811222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f35036-6624-4d33-b0ec-2a5bc5c2532b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:16.862036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 931/1846] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:16 2022] POST /identity/v3/users => generated 307 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:16.863458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d5c6c-fbd0-4e11-8116-488d43e2aa33 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.863763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d5c6c-fbd0-4e11-8116-488d43e2aa33 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.864068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d5c6c-fbd0-4e11-8116-488d43e2aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.888790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-523d5c6c-fbd0-4e11-8116-488d43e2aa33 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:16.890404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-523d5c6c-fbd0-4e11-8116-488d43e2aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:16.916852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e8295-eafe-4820-adb7-1cb82293b092 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:16.933074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:16.933775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:16.934115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:16.934489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] PATH_INFO: `/v3/users/5683b9aab16048bfb0028862874c9eb4` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:16.936333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5683b9aab16048bfb0028862874c9eb4)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:16.938297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.010252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 932/1847] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:59:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:17.011343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d5c6c-fbd0-4e11-8116-488d43e2aa33 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.027365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d5c6c-fbd0-4e11-8116-488d43e2aa33 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.033052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.035199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5683b9aab16048bfb0028862874c9eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.036833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.036833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.037379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.038154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.040013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.057185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 933/1848] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:17.057185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.059115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5683b9aab16048bfb0028862874c9eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.059877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5683b9aab16048bfb0028862874c9eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.061077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5683b9aab16048bfb0028862874c9eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.065029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.075991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5683b9aab16048bfb0028862874c9eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.096287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cadb5-8399-4bd7-b037-582ab47b3d2a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.102639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4d023-6d30-48cc-8139-73b085cd508f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.103468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d023-6d30-48cc-8139-73b085cd508f service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.104071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d023-6d30-48cc-8139-73b085cd508f service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.104420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d023-6d30-48cc-8139-73b085cd508f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.106403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-cbb4d023-6d30-48cc-8139-73b085cd508f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.118973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 916/1849] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:16 2022] DELETE /identity/v3/users/5683b9aab16048bfb0028862874c9eb4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:17.120101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.123713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.126114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4d023-6d30-48cc-8139-73b085cd508f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.128718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4d023-6d30-48cc-8139-73b085cd508f service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.143369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 934/1850] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:17.144781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.145135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.145586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.168505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:17.170140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.231983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f534-254f-4d38-a338-d75bf8c211ae admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.241012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.241751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.242025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.242462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] PATH_INFO: `/v3/projects/24383fa93b564da3b5b322e13d86a0b0/users/546db72c3b4142279dbadebb95aa195b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.255451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 935/1851] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:17.260587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.262018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.266761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] RBAC: Authorizing `identity:create_grant(project_id=24383fa93b564da3b5b322e13d86a0b0, user_id=546db72c3b4142279dbadebb95aa195b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.273588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.275056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee04d32-0ce3-4e2d-a89b-008a60adc5da None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.281706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.282391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.282783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.283227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] PATH_INFO: `/v3/users/fd755425f09846878ad153fb0df4edda` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.284469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd755425f09846878ad153fb0df4edda)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.286743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.300325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 917/1852] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:17 2022] PUT /identity/v3/projects/24383fa93b564da3b5b322e13d86a0b0/users/546db72c3b4142279dbadebb95aa195b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:17.301679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.304158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.339561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:17.340597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:17.373994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd755425f09846878ad153fb0df4edda'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.384326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd755425f09846878ad153fb0df4edda'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.395399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd755425f09846878ad153fb0df4edda'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.396796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd755425f09846878ad153fb0df4edda'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.411393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd755425f09846878ad153fb0df4edda'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:17.419969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 936/1853] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:17 2022] DELETE /identity/v3/users/fd755425f09846878ad153fb0df4edda => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:17.421024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.423575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.462425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde63010-ee65-4f55-9e6c-4c0b89e919be admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.564061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59198f-9f94-4c88-b9cb-d361003eac8a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.570875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.571895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.572368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.573116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.573953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.575871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.592765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 937/1854] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:17.600777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.603685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.604490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.604775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.605037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.608817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.614646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc217f-52f8-449e-9e8f-964b34893c33 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.621768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155ffd3-3e80-4c34-b267-ad974eabf068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.622712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ffd3-3e80-4c34-b267-ad974eabf068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.623158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ffd3-3e80-4c34-b267-ad974eabf068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.623576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155ffd3-3e80-4c34-b267-ad974eabf068 admin admin] PATH_INFO: `/v3/projects/24383fa93b564da3b5b322e13d86a0b0/users/546db72c3b4142279dbadebb95aa195b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.626087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155ffd3-3e80-4c34-b267-ad974eabf068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24383fa93b564da3b5b322e13d86a0b0, user_id=546db72c3b4142279dbadebb95aa195b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.629583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155ffd3-3e80-4c34-b267-ad974eabf068 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.633337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.635192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.653595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 938/1855] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:17 2022] PUT /identity/v3/projects/24383fa93b564da3b5b322e13d86a0b0/users/546db72c3b4142279dbadebb95aa195b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:17.655486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.655801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.656079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.660341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 918/1856] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:17.691348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] MFA Rules not processed for user `546db72c3b4142279dbadebb95aa195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:17.693107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.769878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 939/1857] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:17.785908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.788053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.859104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eccd0-b5d0-4e9b-a34a-5d6224a0dede service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:17.897906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:17.899752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:17.930101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:17.959185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:17.960027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:17.960362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:17.960690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:17.974619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:17.978457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:17.993833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 919/1858] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:17 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:18.065190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cead11-3a2e-4928-9f7e-8c987dc162d4 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:18.080863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:18.081777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:18.085206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:18.088817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] PATH_INFO: `/v3/projects/e186046ef3524181b66b2150505983be` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:18.097298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e186046ef3524181b66b2150505983be)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:18.099307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:18.189946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:18.200048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026502-464a-4b71-9250-3ab9ced18cc0 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:18.215072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e186046ef3524181b66b2150505983be', 'request_id': 'req-14517dbb-9be8-46a4-8781-72b7476ba942'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.233074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e186046ef3524181b66b2150505983be', 'request_id': 'req-14517dbb-9be8-46a4-8781-72b7476ba942'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.270726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e186046ef3524181b66b2150505983be', 'request_id': 'req-14517dbb-9be8-46a4-8781-72b7476ba942'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.308647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:18.321195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] The token cache is being invalidate because project e186046ef3524181b66b2150505983be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:18.321491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.326140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.336210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 940/1859] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:17 2022] DELETE /identity/v3/projects/e186046ef3524181b66b2150505983be => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:18.337204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:18.352370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:18.352370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:18.352370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:18.352370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:18.352870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:18.358349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:18.486792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:18.488290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:18.506740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14517dbb-9be8-46a4-8781-72b7476ba942 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:18.508687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 920/1860] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:18 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:18.518172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:18.518878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:18.519157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:18.519424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] PATH_INFO: `/v3/users/dfa330df6c4b44b1a0c241198ff9ae02` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:18.520706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa330df6c4b44b1a0c241198ff9ae02)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:18.522750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:18.627574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:18.634390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa330df6c4b44b1a0c241198ff9ae02'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.654793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa330df6c4b44b1a0c241198ff9ae02'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.667239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa330df6c4b44b1a0c241198ff9ae02'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.668188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa330df6c4b44b1a0c241198ff9ae02'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.682681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa330df6c4b44b1a0c241198ff9ae02'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:18.691329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 941/1861] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:18 2022] DELETE /identity/v3/users/dfa330df6c4b44b1a0c241198ff9ae02 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:19.441299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:19.443105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:19.481415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f79d-bdd9-4100-842b-3b14de5e123c service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:19.540591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:19.542353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:19.641575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:19.645150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:19.645461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:19.645779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] PATH_INFO: `/v3/projects/bc3ccf676e2d4935a70f2a4e4cff64e4` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:19.648341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3ccf676e2d4935a70f2a4e4cff64e4)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:19.650275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:19.660563 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fefbce-d674-4c0f-9c7e-b2e6925c02f2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:19.666698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:19.668374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:19.668767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:19.669130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] PATH_INFO: `/v3/projects/3dcb9b05cca24ae68a641f9eb068bd58` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:19.670504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcb9b05cca24ae68a641f9eb068bd58)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:19.672595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:19.736763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3ccf676e2d4935a70f2a4e4cff64e4', 'request_id': 'req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.739193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcb9b05cca24ae68a641f9eb068bd58', 'request_id': 'req-82fc5772-72e0-41b4-a7aa-c238d94006df'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.753323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3ccf676e2d4935a70f2a4e4cff64e4', 'request_id': 'req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.761257 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcb9b05cca24ae68a641f9eb068bd58', 'request_id': 'req-82fc5772-72e0-41b4-a7aa-c238d94006df'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.765122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3ccf676e2d4935a70f2a4e4cff64e4', 'request_id': 'req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.771085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcb9b05cca24ae68a641f9eb068bd58', 'request_id': 'req-82fc5772-72e0-41b4-a7aa-c238d94006df'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.786653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] The token cache is being invalidate because project 3dcb9b05cca24ae68a641f9eb068bd58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:19.786937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.788654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-82fc5772-72e0-41b4-a7aa-c238d94006df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.790837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 942/1862] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:19 2022] DELETE /identity/v3/projects/3dcb9b05cca24ae68a641f9eb068bd58 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:19.804512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] The token cache is being invalidate because project bc3ccf676e2d4935a70f2a4e4cff64e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:19.806071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.807054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:19.807485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a50ce-0233-45e2-93b8-acdee887a4b6 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:19.808433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a50ce-0233-45e2-93b8-acdee887a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:19.812716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a50ce-0233-45e2-93b8-acdee887a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:19.819219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 921/1863] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:19 2022] DELETE /identity/v3/projects/bc3ccf676e2d4935a70f2a4e4cff64e4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:19.821953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:19.839741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:19.876775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c66a50ce-0233-45e2-93b8-acdee887a4b6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:19.878019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c66a50ce-0233-45e2-93b8-acdee887a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:19.879722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:19.982174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9688f-53d2-4d70-9e62-25c64e7a0aad admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.018650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:20.049123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 943/1864] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:20.057173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3b4b-933f-44c3-a3e1-dc3e0a543b48 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.057368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3b4b-933f-44c3-a3e1-dc3e0a543b48 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.057636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3b4b-933f-44c3-a3e1-dc3e0a543b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.100052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0d6a3b4b-933f-44c3-a3e1-dc3e0a543b48 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:20.105267 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0d6a3b4b-933f-44c3-a3e1-dc3e0a543b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:20.123419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 944/1865] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:20.125858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3b4b-933f-44c3-a3e1-dc3e0a543b48 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.146378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3b4b-933f-44c3-a3e1-dc3e0a543b48 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.148689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.151320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.153007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.153393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] PATH_INFO: `/v3/users/889b56e5d0ce43e4839062a617ed06d1` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.153568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.154349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.154755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.155318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.156156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:20.156667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.156789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889b56e5d0ce43e4839062a617ed06d1)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.158537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.159857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.198706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 945/1866] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:20.203100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.223829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b25e4-b694-4530-bcb6-90e8579a88db admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.235354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.238282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.239945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.240362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.241249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.246976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.279299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889b56e5d0ce43e4839062a617ed06d1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:20.293516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889b56e5d0ce43e4839062a617ed06d1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:20.294555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889b56e5d0ce43e4839062a617ed06d1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:20.295968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889b56e5d0ce43e4839062a617ed06d1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:20.305200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 946/1867] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:20 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:20.310247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.312551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:20.316076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889b56e5d0ce43e4839062a617ed06d1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:20.353707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 922/1868] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:19 2022] DELETE /identity/v3/users/889b56e5d0ce43e4839062a617ed06d1 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:20.404162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950f10-4416-4c7d-99cc-ecb8fce66f5d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.488431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.489240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.489364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.489728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.490282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.492359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.532393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 947/1869] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:20 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:20.534334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.550245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab7e21-44ef-4f0d-a421-a8dcc4714896 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.559114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.560193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.560522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.560799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.561900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.563537 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.580979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 923/1870] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:20.585878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.599114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e94aec-5637-417d-8e76-6afc7e66c0cd admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.606791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfdb1f-e230-41a8-856e-dd5fb06bd89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.608214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfdb1f-e230-41a8-856e-dd5fb06bd89e admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.608464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfdb1f-e230-41a8-856e-dd5fb06bd89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.608804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfdb1f-e230-41a8-856e-dd5fb06bd89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.619842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfdb1f-e230-41a8-856e-dd5fb06bd89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.619842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfdb1f-e230-41a8-856e-dd5fb06bd89e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.629434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 948/1871] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:20.629889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.645559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83673164-1933-4cd0-b3f8-c4270e523f79 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.652829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.653532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.653860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.654272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] PATH_INFO: `/v3/projects/511e216942ac464686fdd35d48f69293/users/5f70c5e8b637437f832d701dd4352275/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.673837 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511e216942ac464686fdd35d48f69293, user_id=5f70c5e8b637437f832d701dd4352275, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.676585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.707111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 924/1872] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:20 2022] PUT /identity/v3/projects/511e216942ac464686fdd35d48f69293/users/5f70c5e8b637437f832d701dd4352275/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:20.711755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf0d7-619f-40c7-916a-86d86a847131 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.711755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf0d7-619f-40c7-916a-86d86a847131 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.711755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf0d7-619f-40c7-916a-86d86a847131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.744339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0fdaf0d7-619f-40c7-916a-86d86a847131 None None] MFA Rules not processed for user `5f70c5e8b637437f832d701dd4352275`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:20.745592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0fdaf0d7-619f-40c7-916a-86d86a847131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:20.776907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:20.822222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 949/1873] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:20.827192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.833340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:20.901715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8972d38-540b-449d-9cf9-a74c82518154 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:20.906710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:20.906966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:20.907176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:20.907443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:20.908110 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:20.910497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:20.943149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 925/1874] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:20 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:20.947440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaf0d7-619f-40c7-916a-86d86a847131 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:20.958420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaf0d7-619f-40c7-916a-86d86a847131 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:21.037593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:21.038252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.038432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.039077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.039910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:21.043123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:21.075175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 950/1875] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:20 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:21.076487 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:21.095518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b4e5-a2ed-4bc3-b9f0-085d3dff5b8a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:21.117117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:21.117752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.118037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.118307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.119143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:21.120993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:21.132816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 926/1876] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:21.136826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:21.149937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8582-6cb0-4685-8d26-637d3e3819b2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:21.157812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:21.158507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.158820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.159087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] PATH_INFO: `/v3/projects/0482cd8bcc4341bcb447f1f876e5981d/users/c8e86e4d39ec4a76b623cc23d7e565d1/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.180619 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0482cd8bcc4341bcb447f1f876e5981d, user_id=c8e86e4d39ec4a76b623cc23d7e565d1, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:21.184452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:21.207513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 951/1877] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:21 2022] PUT /identity/v3/projects/0482cd8bcc4341bcb447f1f876e5981d/users/c8e86e4d39ec4a76b623cc23d7e565d1/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:21.208703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:21.224935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f9aea-0bd6-4927-b3e0-ac52e3ae6b79 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:21.348320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ed0bd-b511-4dc3-acf9-dc8229cafc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:21.349092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed0bd-b511-4dc3-acf9-dc8229cafc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.350556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed0bd-b511-4dc3-acf9-dc8229cafc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.350764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ed0bd-b511-4dc3-acf9-dc8229cafc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.351329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ed0bd-b511-4dc3-acf9-dc8229cafc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:21.354328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ed0bd-b511-4dc3-acf9-dc8229cafc31 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:21.388574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:21.400182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45757d-d1e6-41e0-a78d-6d150f066e09 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:21.405114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 927/1878] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:21.412144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:21.412819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.413094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.413359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] PATH_INFO: `/v3/projects/0482cd8bcc4341bcb447f1f876e5981d/users/c8e86e4d39ec4a76b623cc23d7e565d1/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.419377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0482cd8bcc4341bcb447f1f876e5981d, user_id=c8e86e4d39ec4a76b623cc23d7e565d1, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:21.423810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:21.447805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.448502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.448502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.453084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 952/1879] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:21 2022] PUT /identity/v3/projects/0482cd8bcc4341bcb447f1f876e5981d/users/c8e86e4d39ec4a76b623cc23d7e565d1/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:21.544215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] MFA Rules not processed for user `c8e86e4d39ec4a76b623cc23d7e565d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:21.544739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:21.547026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:21.549893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:21.717830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:21.727132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 928/1880] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:21.792143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:21.793883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:21.800950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d54cd-b8e0-42d5-9e8b-eabfe21d4e86 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:21.820209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:21.820944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.821220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.821487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] PATH_INFO: `/v3/projects/65830a59d3bb4fd687030ecb64cb57af` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.824083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65830a59d3bb4fd687030ecb64cb57af)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:21.826047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:21.891809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:21.893162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23530205-922a-4571-b8aa-7445d69e9f75 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:21.898594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f9d74-db48-4dab-abbc-2e7850d0054c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:21.899745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9d74-db48-4dab-abbc-2e7850d0054c service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:21.900251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9d74-db48-4dab-abbc-2e7850d0054c service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:21.900934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f9d74-db48-4dab-abbc-2e7850d0054c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:21.914783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f9d74-db48-4dab-abbc-2e7850d0054c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:21.917255 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f9d74-db48-4dab-abbc-2e7850d0054c service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:21.932601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 929/1881] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:21.958892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65830a59d3bb4fd687030ecb64cb57af', 'request_id': 'req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:21.974538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65830a59d3bb4fd687030ecb64cb57af', 'request_id': 'req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:21.987506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65830a59d3bb4fd687030ecb64cb57af', 'request_id': 'req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:22.034286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] The token cache is being invalidate because project 65830a59d3bb4fd687030ecb64cb57af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:22.034871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:22.036082 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cd0b34d6-1b79-4e7a-9e3e-f8b7c3ef1273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:22.040653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 953/1882] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:21 2022] DELETE /identity/v3/projects/65830a59d3bb4fd687030ecb64cb57af => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:22.045711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.046227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.046680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.112418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:22.128722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:22.300409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 930/1883] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:22.308239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224872-92ec-4d37-84b4-206eaeff3918 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.308464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:22.308880 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224872-92ec-4d37-84b4-206eaeff3918 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.309624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224872-92ec-4d37-84b4-206eaeff3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.310280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:22.352338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-30224872-92ec-4d37-84b4-206eaeff3918 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:22.356882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-30224872-92ec-4d37-84b4-206eaeff3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:22.380809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 954/1884] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:22.384680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224872-92ec-4d37-84b4-206eaeff3918 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:22.405368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224872-92ec-4d37-84b4-206eaeff3918 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:22.416633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b108e5f-4f57-4c46-a73f-eb988b05546e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:22.420992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:22.422330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:22.422804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.422985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.423231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.423504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.424623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:22.424930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:22.425439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.425950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.428807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:22.429504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:22.456865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 955/1885] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:22.461091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:22.490099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb19fc-7ea1-4a3e-b9bd-ce20bf15232b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:22.509706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:22.511869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.512303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.514525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.516260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:22.521195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:22.564211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:22.568172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:22.574227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 956/1886] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:22.575423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:22.577120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:22.589120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 931/1887] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:22.662670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b642262-52b9-4096-a964-86a6dc04bb45 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:22.669911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:22.670859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.671399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.672088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.672975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:22.675351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:22.730418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 957/1888] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:22 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:22.734268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:22.748926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9306d9-3692-4116-a566-1246c8969888 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:22.757376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:22.758121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.759058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.759397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.760753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:22.764027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:22.795054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 932/1889] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:22.797565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:22.816729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab6ae-f261-4331-b744-85ed5eaaa35d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:22.825949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6db6d6-7409-4bb8-ba27-88fee444a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:22.826970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db6d6-7409-4bb8-ba27-88fee444a380 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.827607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db6d6-7409-4bb8-ba27-88fee444a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.827991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db6d6-7409-4bb8-ba27-88fee444a380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.829043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6db6d6-7409-4bb8-ba27-88fee444a380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:22.831282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6db6d6-7409-4bb8-ba27-88fee444a380 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:22.851288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 958/1890] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:22.856810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:22.869664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add57e-86d4-428d-9817-7cca22cbeb0f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:22.876262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:22.877142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.877429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.877689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] PATH_INFO: `/v3/projects/ab6998cdbf0a4d7a803d7b433d9c089f/users/1c3cfd8056d543e1a6d78d3b3950a763/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.895272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6998cdbf0a4d7a803d7b433d9c089f, user_id=1c3cfd8056d543e1a6d78d3b3950a763, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:22.898109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:22.930800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 933/1891] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:22 2022] PUT /identity/v3/projects/ab6998cdbf0a4d7a803d7b433d9c089f/users/1c3cfd8056d543e1a6d78d3b3950a763/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:22.937712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462a94-6843-4eb4-ada0-924662fb7ac5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:22.938017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462a94-6843-4eb4-ada0-924662fb7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:22.938324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462a94-6843-4eb4-ada0-924662fb7ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:22.969953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e0462a94-6843-4eb4-ada0-924662fb7ac5 None None] MFA Rules not processed for user `1c3cfd8056d543e1a6d78d3b3950a763`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:22.971525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e0462a94-6843-4eb4-ada0-924662fb7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:23.013221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:23.046710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 959/1892] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:23.058686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:23.128744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005062a-feaf-4b3e-89f6-a2f649c27d4f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:23.132505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c2ce5-6160-4b4e-87e4-6dc4a2cb2b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:23.133150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c2ce5-6160-4b4e-87e4-6dc4a2cb2b4a service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:23.133428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c2ce5-6160-4b4e-87e4-6dc4a2cb2b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:23.133698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c2ce5-6160-4b4e-87e4-6dc4a2cb2b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:23.142333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c2ce5-6160-4b4e-87e4-6dc4a2cb2b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:23.143805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c2ce5-6160-4b4e-87e4-6dc4a2cb2b4a service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:23.153240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 934/1893] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:23.572770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb9da-912d-44d3-b946-15951415bb5e None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:23.572770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb9da-912d-44d3-b946-15951415bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:23.572770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fb9da-912d-44d3-b946-15951415bb5e None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:23.574219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 960/1894] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:59:23.595281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:23.596221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:23.596330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:23.635267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:23.638239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:23.821765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 935/1895] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:59:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:23.860625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb9da-912d-44d3-b946-15951415bb5e None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:23.863456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-645fb9da-912d-44d3-b946-15951415bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:23.936565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:23.938644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:23.967223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ae57-1a73-4b1d-966b-c8542dd3328a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:23.981570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eeb05-c8ca-4032-a98c-7fec2cbe289b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:23.982251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eeb05-c8ca-4032-a98c-7fec2cbe289b service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:23.982528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eeb05-c8ca-4032-a98c-7fec2cbe289b service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:23.982793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eeb05-c8ca-4032-a98c-7fec2cbe289b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:24.005735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3eeb05-c8ca-4032-a98c-7fec2cbe289b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:24.013063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3eeb05-c8ca-4032-a98c-7fec2cbe289b service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:24.039162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 936/1896] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:24.041071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fb9da-912d-44d3-b946-15951415bb5e None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:24.048642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:24.049574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:24.050054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:24.050503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] PATH_INFO: `/v3/users/23e999fd035d44af88229f9d6cc10c0c` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:24.052251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e999fd035d44af88229f9d6cc10c0c)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:24.054786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:24.153455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e999fd035d44af88229f9d6cc10c0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:24.177850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e999fd035d44af88229f9d6cc10c0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:24.192874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e999fd035d44af88229f9d6cc10c0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:24.196306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e999fd035d44af88229f9d6cc10c0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:24.223040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e999fd035d44af88229f9d6cc10c0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:24.254520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 961/1897] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:23 2022] DELETE /identity/v3/users/23e999fd035d44af88229f9d6cc10c0c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:24.256768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:24.257108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:24.257419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:24.292386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:24.294730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:24.372999 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:24.423552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 937/1898] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:24.460293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:24.461746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:24.601391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1121e-94da-4b6e-8831-a27533ca51b1 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:24.606299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:24.606934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:24.607209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:24.607515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:24.619516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:24.621501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:24.626193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:24.634363 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 962/1899] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:25.029119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:25.030631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:25.050460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2157-1e66-4dd4-8c87-c3ffd90c9a22 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:25.057511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:25.058629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:25.059104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:25.059535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] PATH_INFO: `/v3/projects/4d3ee8a041e643a385369584711c772b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:25.061304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3ee8a041e643a385369584711c772b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:25.072027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:25.134456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3ee8a041e643a385369584711c772b', 'request_id': 'req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.164581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3ee8a041e643a385369584711c772b', 'request_id': 'req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.175194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3ee8a041e643a385369584711c772b', 'request_id': 'req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.188354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] The token cache is being invalidate because project 4d3ee8a041e643a385369584711c772b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:25.196274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.196274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.196274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 938/1900] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:25 2022] DELETE /identity/v3/projects/4d3ee8a041e643a385369584711c772b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:25.197148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:25.218507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32096bce-7447-4578-93ab-60c99f6fe0c5 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:25.309833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:25.310677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:25.312716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:25.312937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] PATH_INFO: `/v3/users/546db72c3b4142279dbadebb95aa195b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:25.314209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546db72c3b4142279dbadebb95aa195b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:25.316841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:25.402841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546db72c3b4142279dbadebb95aa195b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.416490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546db72c3b4142279dbadebb95aa195b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.424401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546db72c3b4142279dbadebb95aa195b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.425117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546db72c3b4142279dbadebb95aa195b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.447331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c9658eab-27df-475c-a51d-dfe960f84a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546db72c3b4142279dbadebb95aa195b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:25.454405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 963/1901] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:25 2022] DELETE /identity/v3/users/546db72c3b4142279dbadebb95aa195b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:25.908111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:25.909816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:25.926149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f50f2-3a6b-44fb-960d-a59f5cf97987 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.010895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.011436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.011879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.012815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] PATH_INFO: `/v3/projects/24383fa93b564da3b5b322e13d86a0b0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.014920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24383fa93b564da3b5b322e13d86a0b0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.018119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.104007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24383fa93b564da3b5b322e13d86a0b0', 'request_id': 'req-34d84fd8-bbf1-4691-828b-d4af13535b13'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:26.113732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24383fa93b564da3b5b322e13d86a0b0', 'request_id': 'req-34d84fd8-bbf1-4691-828b-d4af13535b13'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:26.120577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24383fa93b564da3b5b322e13d86a0b0', 'request_id': 'req-34d84fd8-bbf1-4691-828b-d4af13535b13'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:26.129386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:26.139206 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] The token cache is being invalidate because project 24383fa93b564da3b5b322e13d86a0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:26.141659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:26.142894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34d84fd8-bbf1-4691-828b-d4af13535b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:26.147194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 939/1902] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:25 2022] DELETE /identity/v3/projects/24383fa93b564da3b5b322e13d86a0b0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:26.152362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7b9b-1159-433d-9e03-f236f7807f87 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.152648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7b9b-1159-433d-9e03-f236f7807f87 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.152951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7b9b-1159-433d-9e03-f236f7807f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.184309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2a3e7b9b-1159-433d-9e03-f236f7807f87 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:26.185093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2a3e7b9b-1159-433d-9e03-f236f7807f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:26.271682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 964/1903] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:26.279282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883682e-019d-4832-9b82-e20e7ddcf160 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.279734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883682e-019d-4832-9b82-e20e7ddcf160 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.279858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883682e-019d-4832-9b82-e20e7ddcf160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.301515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f883682e-019d-4832-9b82-e20e7ddcf160 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:26.302743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f883682e-019d-4832-9b82-e20e7ddcf160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:26.313445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 940/1904] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:26.319227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7b9b-1159-433d-9e03-f236f7807f87 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:26.336860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e7b9b-1159-433d-9e03-f236f7807f87 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.345210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.346706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.347319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.348082 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.348971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:26.349462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.352145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.369127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 965/1905] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:26.373663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883682e-019d-4832-9b82-e20e7ddcf160 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:26.386966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883682e-019d-4832-9b82-e20e7ddcf160 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.394057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.394682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.395548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.395915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.396605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.398676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.441171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 941/1906] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:26 2022] POST /identity/v3/projects => generated 361 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:26.445456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:26.452876 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:26.457022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c10df9-af55-46b7-9701-ec3c7be4b5cf admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.520581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.521207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.521487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.521757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.522403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.524438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.548933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 966/1907] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:26 2022] POST /identity/v3/users => generated 281 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:26.552831 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:26.569674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c99c3-1252-459e-8c4b-5cfd77533b7b admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.583921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.593288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.593288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.593288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.593288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.593288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.601440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 942/1908] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:26.602666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:26.613454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4309d0-156a-44f9-bb56-f593993696c0 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.618748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1b5bd-ea67-45ac-9a03-70f084878ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.619463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b5bd-ea67-45ac-9a03-70f084878ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.619849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b5bd-ea67-45ac-9a03-70f084878ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.620186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1b5bd-ea67-45ac-9a03-70f084878ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.620912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b5bd-ea67-45ac-9a03-70f084878ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.622573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1b5bd-ea67-45ac-9a03-70f084878ee4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.635228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 967/1909] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:26.639539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:26.650216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4516c-de51-4904-9351-dfd44efb9b30 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.655010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.655680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.655986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.656382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] PATH_INFO: `/v3/projects/9c2c7fd0c4164782ab1e93321e4b5cd8/users/596bc60949774ef1a90b3d2d869bd219/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.674093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2c7fd0c4164782ab1e93321e4b5cd8, user_id=596bc60949774ef1a90b3d2d869bd219, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.677298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.693716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 943/1910] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:26 2022] PUT /identity/v3/projects/9c2c7fd0c4164782ab1e93321e4b5cd8/users/596bc60949774ef1a90b3d2d869bd219/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:26.705236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b76d0-2f86-4ade-a429-fb991faff3ff None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.705519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b76d0-2f86-4ade-a429-fb991faff3ff None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.705786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b76d0-2f86-4ade-a429-fb991faff3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.735912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-811b76d0-2f86-4ade-a429-fb991faff3ff None None] MFA Rules not processed for user `596bc60949774ef1a90b3d2d869bd219`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:26.737136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-811b76d0-2f86-4ade-a429-fb991faff3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:26.805444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 968/1911] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:26.844471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:26.847027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:26.944195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0df4c-95cf-4fda-abaa-5417287e1386 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:26.948071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4b4f4-c38a-47b2-b6f5-dab25a4fdf5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:26.948603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4b4f4-c38a-47b2-b6f5-dab25a4fdf5d service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:26.948906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4b4f4-c38a-47b2-b6f5-dab25a4fdf5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:26.949128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4b4f4-c38a-47b2-b6f5-dab25a4fdf5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:26.962443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4b4f4-c38a-47b2-b6f5-dab25a4fdf5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:26.964548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4b4f4-c38a-47b2-b6f5-dab25a4fdf5d service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:26.975547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 944/1912] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:26.991976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b76d0-2f86-4ade-a429-fb991faff3ff None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:27.067253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b76d0-2f86-4ade-a429-fb991faff3ff None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:27.075404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:27.076100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:27.076380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:27.076658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] PATH_INFO: `/v3/users/596bc60949774ef1a90b3d2d869bd219` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:27.077844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596bc60949774ef1a90b3d2d869bd219)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:27.079940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:27.104916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:27.144088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596bc60949774ef1a90b3d2d869bd219'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:27.157379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596bc60949774ef1a90b3d2d869bd219'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:27.168327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596bc60949774ef1a90b3d2d869bd219'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:27.169198 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596bc60949774ef1a90b3d2d869bd219'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:27.188731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596bc60949774ef1a90b3d2d869bd219'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:27.195709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 969/1913] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:26 2022] DELETE /identity/v3/users/596bc60949774ef1a90b3d2d869bd219 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:27.200295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:27.200821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:27.201073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:27.233912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:27.235903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:27.324732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 945/1914] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:27.338031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:27.340160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:27.460520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f0f05-ddd2-4049-b3ec-fb94adbdb974 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:27.473934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c714d4-b1b2-4902-ad4a-9797129a56f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:27.476058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c714d4-b1b2-4902-ad4a-9797129a56f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:27.476336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c714d4-b1b2-4902-ad4a-9797129a56f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:27.480164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c714d4-b1b2-4902-ad4a-9797129a56f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:27.505078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c714d4-b1b2-4902-ad4a-9797129a56f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:27.507406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c714d4-b1b2-4902-ad4a-9797129a56f0 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:27.537883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 970/1915] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:27.966884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:27.968387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:27.984335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7edfaa-8f39-4887-acb2-51c22d21b5af None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:27.989933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:27.990103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:27.990440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:27.990771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] PATH_INFO: `/v3/projects/9c2c7fd0c4164782ab1e93321e4b5cd8` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:27.992001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2c7fd0c4164782ab1e93321e4b5cd8)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:27.994048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:28.048735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:28.093738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2c7fd0c4164782ab1e93321e4b5cd8', 'request_id': 'req-04961812-2bad-4a4c-8b12-a6e626e61565'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:28.115626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2c7fd0c4164782ab1e93321e4b5cd8', 'request_id': 'req-04961812-2bad-4a4c-8b12-a6e626e61565'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:28.122958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2c7fd0c4164782ab1e93321e4b5cd8', 'request_id': 'req-04961812-2bad-4a4c-8b12-a6e626e61565'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:28.138670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] The token cache is being invalidate because project 9c2c7fd0c4164782ab1e93321e4b5cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:28.138962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:28.139649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-04961812-2bad-4a4c-8b12-a6e626e61565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:28.142188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 946/1916] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:27 2022] DELETE /identity/v3/projects/9c2c7fd0c4164782ab1e93321e4b5cd8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:28.147384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ed54-157f-49f3-829c-08a3e7a12ec9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.147856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ed54-157f-49f3-829c-08a3e7a12ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.147975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709ed54-157f-49f3-829c-08a3e7a12ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.191100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4709ed54-157f-49f3-829c-08a3e7a12ec9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:28.192412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4709ed54-157f-49f3-829c-08a3e7a12ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:28.312475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 971/1917] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:28.312702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0898-aa36-4dac-82c1-cd85d03257b6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.312702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0898-aa36-4dac-82c1-cd85d03257b6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.312702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0898-aa36-4dac-82c1-cd85d03257b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.343025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-04fc0898-aa36-4dac-82c1-cd85d03257b6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:28.344494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-04fc0898-aa36-4dac-82c1-cd85d03257b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:28.353799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 947/1918] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:28.358313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709ed54-157f-49f3-829c-08a3e7a12ec9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:28.370000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709ed54-157f-49f3-829c-08a3e7a12ec9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:28.375197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:28.375914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.376191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.376518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.377184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:28.377483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:28.379134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:28.396899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 972/1919] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:59:28.398133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0898-aa36-4dac-82c1-cd85d03257b6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:28.411626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0898-aa36-4dac-82c1-cd85d03257b6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:28.417628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:28.418264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.418539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.418805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.419453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:28.421440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:28.458380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 948/1920] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:28 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:28.463624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:28.476281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dd583-cc77-4ea6-974f-2d1d860f2de3 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:28.502012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:28.552067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:28.552797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.553107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.553410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.554201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:28.557733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:28.582291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 973/1921] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:28 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:28.586424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:28.602158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e1454-cf3a-44d9-ae2b-b12f058eede6 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:28.607852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:28.608506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.608856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.609210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.610562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:28.612983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:28.627955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 949/1922] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:28.630126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:28.643111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5937ff-8197-4735-a67a-8b96739095b8 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:28.663564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b03c31-e4e5-4149-9237-09358e81b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:28.664390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03c31-e4e5-4149-9237-09358e81b0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.664519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03c31-e4e5-4149-9237-09358e81b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.664773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03c31-e4e5-4149-9237-09358e81b0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.668723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b03c31-e4e5-4149-9237-09358e81b0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:28.673301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b03c31-e4e5-4149-9237-09358e81b0b6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:28.700449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 974/1923] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:28.705704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:28.721199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ea33-75ed-4af1-9f23-540f72d4e69a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:28.727722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:28.731947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.733392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.733820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] PATH_INFO: `/v3/projects/63dabb30106144b99a99defd4faaaa05/users/02a3893c9bc9435d9d65c7c6e9244d5b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.767081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dabb30106144b99a99defd4faaaa05, user_id=02a3893c9bc9435d9d65c7c6e9244d5b, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:28.770591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:28.798771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 950/1924] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:28 2022] PUT /identity/v3/projects/63dabb30106144b99a99defd4faaaa05/users/02a3893c9bc9435d9d65c7c6e9244d5b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:28.810458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df40f-0aef-4ed1-89e0-e2bc3b3da887 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:28.810741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df40f-0aef-4ed1-89e0-e2bc3b3da887 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:28.811007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31df40f-0aef-4ed1-89e0-e2bc3b3da887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:28.842592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e31df40f-0aef-4ed1-89e0-e2bc3b3da887 None None] MFA Rules not processed for user `02a3893c9bc9435d9d65c7c6e9244d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:28.844355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e31df40f-0aef-4ed1-89e0-e2bc3b3da887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:28.951345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 975/1925] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:28.956271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:29.067666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c957-fc29-4b77-af67-022b764bfd5a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:29.078171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:29.080816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:29.081354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:29.081746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:29.082545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:29.091501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:29.188598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31df40f-0aef-4ed1-89e0-e2bc3b3da887 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:29.188834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 951/1926] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:28 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:29.206538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31df40f-0aef-4ed1-89e0-e2bc3b3da887 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:29.369469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:29.370906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:29.371405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:29.371897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:29.374029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:29.413034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:29.471777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 976/1927] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:29 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:29.473711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:29.485367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee994e2d-c1ec-4110-846b-77ca6501c5e7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:29.498438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:29.499755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:29.500129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:29.500524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:29.502183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:29.504113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:29.545352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 952/1928] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:29.549610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:29.563495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a286b4-1b94-4cdc-b372-fd5c77a53e8b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:29.568919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9e00-d1fd-482f-a163-0116cb2f37fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:29.569718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9e00-d1fd-482f-a163-0116cb2f37fe admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:29.570095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9e00-d1fd-482f-a163-0116cb2f37fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:29.570500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9e00-d1fd-482f-a163-0116cb2f37fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:29.571251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9e00-d1fd-482f-a163-0116cb2f37fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:29.573826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa9e00-d1fd-482f-a163-0116cb2f37fe admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:29.591083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 977/1929] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:29.592683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:29.609347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02d6f0-9b87-403c-871f-4caea0c3c303 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:29.617961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:29.619059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:29.619668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:29.621481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] PATH_INFO: `/v3/projects/d9893c7eb5ba4f79aed2c980981a1427/users/b70700e110e0470aa6a0c913ae2334cf/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:29.644012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9893c7eb5ba4f79aed2c980981a1427, user_id=b70700e110e0470aa6a0c913ae2334cf, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:29.647237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:29.674906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 953/1930] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:29 2022] PUT /identity/v3/projects/d9893c7eb5ba4f79aed2c980981a1427/users/b70700e110e0470aa6a0c913ae2334cf/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:29.683100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c893e9-3691-4f5b-9b5e-9ef950d2fe7f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:29.683983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c893e9-3691-4f5b-9b5e-9ef950d2fe7f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:29.684470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c893e9-3691-4f5b-9b5e-9ef950d2fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:29.718899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:29.733390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-40c893e9-3691-4f5b-9b5e-9ef950d2fe7f None None] MFA Rules not processed for user `b70700e110e0470aa6a0c913ae2334cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:29.734628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-40c893e9-3691-4f5b-9b5e-9ef950d2fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:29.826456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 978/1931] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:29.830973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:29.842441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:29.905087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38233e85-245a-4a2f-b6c8-832f385cb3cd admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:29.909892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:29.910588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:29.910863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:29.911263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:29.911918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:29.914009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:29.951651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c893e9-3691-4f5b-9b5e-9ef950d2fe7f None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:29.955850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 954/1932] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:29 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:29.967827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c893e9-3691-4f5b-9b5e-9ef950d2fe7f None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:30.048773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:30.049716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:30.050151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:30.050548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:30.051546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:30.054605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:30.080023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 979/1933] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:29 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:30.084287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:30.095657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9820432-b7cb-47f6-8e2a-f731feccd65d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:30.101061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:30.101698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:30.101971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:30.102238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:30.102891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:30.104681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:30.120575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 955/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:30.121829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:30.134224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ee86-a53a-4248-9f76-49d228656056 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:30.139289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:30.140091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:30.140412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:30.140774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] PATH_INFO: `/v3/projects/03b20c5688db4751bb0daa423d15ba68/users/a569a8cd80ea4d05b544bf7292e4e68b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:30.158446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b20c5688db4751bb0daa423d15ba68, user_id=a569a8cd80ea4d05b544bf7292e4e68b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:30.161599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:30.177793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 980/1935] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:30 2022] PUT /identity/v3/projects/03b20c5688db4751bb0daa423d15ba68/users/a569a8cd80ea4d05b544bf7292e4e68b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:30.181986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:30.192952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a60b4a-d0b4-4864-97fe-c21c034a6d90 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:30.255162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a882a2-6652-43ab-88b2-2e85e6b777e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:30.255979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a882a2-6652-43ab-88b2-2e85e6b777e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:30.256332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a882a2-6652-43ab-88b2-2e85e6b777e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:30.256695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a882a2-6652-43ab-88b2-2e85e6b777e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:30.257403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a882a2-6652-43ab-88b2-2e85e6b777e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:30.261756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a882a2-6652-43ab-88b2-2e85e6b777e1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:30.280703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 956/1936] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:30.281931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:30.294336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069521-d6eb-4601-a76c-2b11694ef489 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:30.300789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:30.302004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:30.302285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:30.302554 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] PATH_INFO: `/v3/projects/03b20c5688db4751bb0daa423d15ba68/users/a569a8cd80ea4d05b544bf7292e4e68b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:30.306508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b20c5688db4751bb0daa423d15ba68, user_id=a569a8cd80ea4d05b544bf7292e4e68b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:30.309459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:30.321418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 981/1937] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:30 2022] PUT /identity/v3/projects/03b20c5688db4751bb0daa423d15ba68/users/a569a8cd80ea4d05b544bf7292e4e68b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:30.332813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb126-5a29-456b-92b3-fba3d73f0ba4 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:30.333089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb126-5a29-456b-92b3-fba3d73f0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:30.333372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb126-5a29-456b-92b3-fba3d73f0ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:30.379132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-bb0eb126-5a29-456b-92b3-fba3d73f0ba4 None None] MFA Rules not processed for user `a569a8cd80ea4d05b544bf7292e4e68b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:30.380380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bb0eb126-5a29-456b-92b3-fba3d73f0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:30.503856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 957/1938] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:30.511883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:30.513682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:30.575567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e0e5-bab4-47b9-816e-dcdf71ed841d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:30.580941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:30.581662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:30.582026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:30.582690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:30.588984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:30.654479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:30.656208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:30.666738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 982/1939] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:32.751833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eb126-5a29-456b-92b3-fba3d73f0ba4 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:32.756985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:32.764544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eb126-5a29-456b-92b3-fba3d73f0ba4 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:32.773385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:32.774054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:32.774586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:32.774861 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:32.839925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:32.841367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:32.852231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 958/1940] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:33.792241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:33.794774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:33.806383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efc45-1956-4639-91c8-de4cd2462e83 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:33.810281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6777ea-7e65-4c61-a662-b579d3774b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:33.810964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6777ea-7e65-4c61-a662-b579d3774b76 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:33.811235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6777ea-7e65-4c61-a662-b579d3774b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:33.811508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6777ea-7e65-4c61-a662-b579d3774b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:33.821787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6777ea-7e65-4c61-a662-b579d3774b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:33.823438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6777ea-7e65-4c61-a662-b579d3774b76 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:33.833048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 983/1941] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:34.715822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:34.717585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:34.813075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ddfa5-7f39-41ff-bc90-4f4dcdfefea9 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:34.817771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:34.818639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:34.819047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:34.819325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] PATH_INFO: `/v3/users/f3167d9108df4167813599957d89b88d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:34.820752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3167d9108df4167813599957d89b88d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:34.822907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:34.885232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3167d9108df4167813599957d89b88d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:34.897940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3167d9108df4167813599957d89b88d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:34.898860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3167d9108df4167813599957d89b88d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:34.899858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3167d9108df4167813599957d89b88d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:34.909663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3167d9108df4167813599957d89b88d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:34.933840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 959/1942] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:34 2022] DELETE /identity/v3/users/f3167d9108df4167813599957d89b88d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:34.939097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:34.939607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:34.940254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:34.968533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:34.972470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:35.049275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 984/1943] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:35.063079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:35.064510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:35.100567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:35.209471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc58876-d7fd-4627-9e1a-38b83539b266 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:35.222120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:35.222898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:35.223228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:35.223574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:35.235133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:35.236638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:35.249568 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 960/1944] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:35.768807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:35.770782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:35.791448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071aeee-69d6-4fdf-8cea-90ae9f14a655 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:35.800775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:35.802828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:35.803431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:35.804090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] PATH_INFO: `/v3/projects/b02c53cc227741deb5aa314e42b58437` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:35.805669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02c53cc227741deb5aa314e42b58437)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:35.808961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:35.911112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02c53cc227741deb5aa314e42b58437', 'request_id': 'req-5c094322-a6d2-4306-ae5e-f922a2c3fef0'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:35.937838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02c53cc227741deb5aa314e42b58437', 'request_id': 'req-5c094322-a6d2-4306-ae5e-f922a2c3fef0'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:35.947340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02c53cc227741deb5aa314e42b58437', 'request_id': 'req-5c094322-a6d2-4306-ae5e-f922a2c3fef0'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:35.975231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] The token cache is being invalidate because project b02c53cc227741deb5aa314e42b58437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:35.975528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:35.976382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:35.978109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 985/1945] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:35 2022] DELETE /identity/v3/projects/b02c53cc227741deb5aa314e42b58437 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:35.982759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:36.001464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8456ae-38ff-4ec2-9b08-da36b3b59c02 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:36.124291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:36.124982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.125251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.125514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] PATH_INFO: `/v3/users/d030eb730ad94b70bae0d541ffc2c69b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.126725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d030eb730ad94b70bae0d541ffc2c69b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:36.128881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:36.194700 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd030eb730ad94b70bae0d541ffc2c69b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.198695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:36.200318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:36.206679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd030eb730ad94b70bae0d541ffc2c69b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.207319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd030eb730ad94b70bae0d541ffc2c69b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.208128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd030eb730ad94b70bae0d541ffc2c69b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.213682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c094322-a6d2-4306-ae5e-f922a2c3fef0 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:36.219839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-439a255c-38ef-4593-aa18-7aacd48dfba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd030eb730ad94b70bae0d541ffc2c69b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.220016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:36.221235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.221928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.222202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] PATH_INFO: `/v3/users/1c3cfd8056d543e1a6d78d3b3950a763` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.223907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3cfd8056d543e1a6d78d3b3950a763)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:36.225930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:36.241921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:36.242660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 961/1946] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:35 2022] DELETE /identity/v3/users/d030eb730ad94b70bae0d541ffc2c69b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:36.298236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3cfd8056d543e1a6d78d3b3950a763'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.307562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3cfd8056d543e1a6d78d3b3950a763'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.317424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3cfd8056d543e1a6d78d3b3950a763'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.318138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3cfd8056d543e1a6d78d3b3950a763'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.333437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3cfd8056d543e1a6d78d3b3950a763'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.339841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 986/1947] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:36 2022] DELETE /identity/v3/users/1c3cfd8056d543e1a6d78d3b3950a763 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:36.344633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.345456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.345753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.367992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:36.369392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:36.414692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:36.460856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 962/1948] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:36.477233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:36.480310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:36.551904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e8ad-cce6-4d37-9647-f0a33d46c86f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:36.556122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4d4c0-dcb9-4d0c-b41b-98f989b9df13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:36.556962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4d4c0-dcb9-4d0c-b41b-98f989b9df13 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.557608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4d4c0-dcb9-4d0c-b41b-98f989b9df13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.558122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4d4c0-dcb9-4d0c-b41b-98f989b9df13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.566312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:36.568897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:36.569274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4d4c0-dcb9-4d0c-b41b-98f989b9df13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:36.570729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4d4c0-dcb9-4d0c-b41b-98f989b9df13 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:36.582911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbef36-72cf-4a97-abd4-7a405fd89d7f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:36.584480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 987/1949] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:36.592153 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:36.593021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.593294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.593559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] PATH_INFO: `/v3/projects/69c5b48631f348da8b30ac31b9463466` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.594696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c5b48631f348da8b30ac31b9463466)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:36.597436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:36.691570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c5b48631f348da8b30ac31b9463466', 'request_id': 'req-b1c596fe-631c-4792-8d28-372b28765692'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.702189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c5b48631f348da8b30ac31b9463466', 'request_id': 'req-b1c596fe-631c-4792-8d28-372b28765692'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.711849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c5b48631f348da8b30ac31b9463466', 'request_id': 'req-b1c596fe-631c-4792-8d28-372b28765692'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.732031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] The token cache is being invalidate because project 69c5b48631f348da8b30ac31b9463466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:36.732706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.735194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b1c596fe-631c-4792-8d28-372b28765692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:36.737544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 963/1950] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:36 2022] DELETE /identity/v3/projects/69c5b48631f348da8b30ac31b9463466 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:36.748582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b708e-dc0f-4f60-abe7-606d76a7f263 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.748866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b708e-dc0f-4f60-abe7-606d76a7f263 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.749279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b708e-dc0f-4f60-abe7-606d76a7f263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.783721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7b9b708e-dc0f-4f60-abe7-606d76a7f263 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:36.785110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7b9b708e-dc0f-4f60-abe7-606d76a7f263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:36.876643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 988/1951] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:36.884539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8edbd4-59fc-4b72-acbf-95ba9e09edfc None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.884979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8edbd4-59fc-4b72-acbf-95ba9e09edfc None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.885269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8edbd4-59fc-4b72-acbf-95ba9e09edfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.928510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ff8edbd4-59fc-4b72-acbf-95ba9e09edfc None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:36.929767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ff8edbd4-59fc-4b72-acbf-95ba9e09edfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:36.940735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 964/1952] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:36.958956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b708e-dc0f-4f60-abe7-606d76a7f263 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:36.972112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b708e-dc0f-4f60-abe7-606d76a7f263 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:36.978599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:36.979415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:36.980173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:36.980626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:36.981711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:36.982241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:36.984368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.006478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 989/1953] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:37.007231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8edbd4-59fc-4b72-acbf-95ba9e09edfc None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.018587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8edbd4-59fc-4b72-acbf-95ba9e09edfc None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.023515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.024234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.024498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.024760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.025408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.028032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.066199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 965/1954] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:37 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:37.067801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.082743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd729-7381-4773-9cb8-781d5d1a0883 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.102377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:37.197479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.198376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.198937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.199324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.200301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.202660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.247388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 990/1955] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:37 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:37.249117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.262900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca86c2-394c-4fe4-a250-b21ff3ec35e5 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.278643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.279523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.279899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.280228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.280993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.282881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.311401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 966/1956] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:37.316126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.331914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48293d2-5271-427f-aec5-6ae8474fbaf3 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.339986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.341003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.341553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.341908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.342258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.343333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.344478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:37.346074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.361952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 991/1957] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:37.365670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.371615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c238c7e-a949-45dc-a793-48832015d7f7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.384277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb52b6-2c41-4cb1-a309-93a5c51b8acb admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.393629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.395965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.396343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f6ea4-7ead-48cb-80ed-afe3b586e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.396844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.398438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] PATH_INFO: `/v3/projects/ab6998cdbf0a4d7a803d7b433d9c089f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.399943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6ea4-7ead-48cb-80ed-afe3b586e04b admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.400247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6ea4-7ead-48cb-80ed-afe3b586e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.400674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f6ea4-7ead-48cb-80ed-afe3b586e04b admin admin] PATH_INFO: `/v3/projects/563fbfd9e5294a3c956b087d58b02d0b/users/ddf7c304b58040a09b6c9d4fd231db4c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.400825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6998cdbf0a4d7a803d7b433d9c089f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.403323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.447860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f6ea4-7ead-48cb-80ed-afe3b586e04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=563fbfd9e5294a3c956b087d58b02d0b, user_id=ddf7c304b58040a09b6c9d4fd231db4c, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.451051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f6ea4-7ead-48cb-80ed-afe3b586e04b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.489224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 992/1958] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:37 2022] PUT /identity/v3/projects/563fbfd9e5294a3c956b087d58b02d0b/users/ddf7c304b58040a09b6c9d4fd231db4c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:37.502695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.503882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.505210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.536235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6998cdbf0a4d7a803d7b433d9c089f', 'request_id': 'req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:37.554049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] MFA Rules not processed for user `ddf7c304b58040a09b6c9d4fd231db4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:37.555358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:37.557797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6998cdbf0a4d7a803d7b433d9c089f', 'request_id': 'req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:37.581955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6998cdbf0a4d7a803d7b433d9c089f', 'request_id': 'req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:37.613253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] The token cache is being invalidate because project ab6998cdbf0a4d7a803d7b433d9c089f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:37.613610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:37.616257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f427bb38-4c4a-48b0-8a1a-1bdb25ba54ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:37.625967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 967/1959] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:37 2022] DELETE /identity/v3/projects/ab6998cdbf0a4d7a803d7b433d9c089f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:37.627177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd3600-0317-4ff5-b178-5966bdc25919 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.627461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd3600-0317-4ff5-b178-5966bdc25919 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.627747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd3600-0317-4ff5-b178-5966bdc25919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.677555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a4dd3600-0317-4ff5-b178-5966bdc25919 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:37.678817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a4dd3600-0317-4ff5-b178-5966bdc25919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:37.686634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:37.731751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 993/1960] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:37.735939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.740541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:37.806144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 968/1961] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:37.814605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec4ce1-48e5-42c7-abad-6d75efb7b2cd None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.815127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec4ce1-48e5-42c7-abad-6d75efb7b2cd None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.815542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec4ce1-48e5-42c7-abad-6d75efb7b2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.864521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-34ec4ce1-48e5-42c7-abad-6d75efb7b2cd None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:37.864521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-34ec4ce1-48e5-42c7-abad-6d75efb7b2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:37.879786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 969/1962] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:37.885938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec4ce1-48e5-42c7-abad-6d75efb7b2cd None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.903401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec4ce1-48e5-42c7-abad-6d75efb7b2cd None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.917570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.918211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.919845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.920405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.921361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:37.922466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.925808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.943837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6df7c5-e6fd-4617-a1c9-aefa1e456097 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.949878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 970/1963] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:37.950991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:37.956455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.960665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.962236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.962750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.963767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.966902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bcb28-fade-491a-92d2-711b45ee0f37 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:37.967548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:37.973896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:37.974207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:37.974435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:37.974800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:37.975646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:37.976642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:37.978805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.022303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 971/1964] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:37 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:38.023480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.036787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 994/1965] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:37 2022] POST /identity/v3/projects => generated 367 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:38.038451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.138355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d6898-8a07-4cf1-9e1a-c88957038356 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.146251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4957-8a63-4d70-a067-8e280094b989 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.152290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.153279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.153929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.154404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.155431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.156423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.157054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.157341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.157638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.158696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.160406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.160534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.198835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 995/1966] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:38 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:38.210316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.220769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 972/1967] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:38 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:38.223044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.227486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60a173-86d4-4a96-8af8-eece01cc4144 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.233484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.235173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.235173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.235173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.235877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.238525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.250439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9076f4-829a-41ec-bea7-8fb38feea2e8 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.256561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 996/1968] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:38.263182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.264712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.265348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.265625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.265890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.268715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.271557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.277063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4acb3-f790-44c1-9b7c-c655fabd3ae2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.283282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.284184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.284461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.284730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] PATH_INFO: `/v3/projects/711c74357e1d4532bbcd21e21bca614b/users/66026d2c858d489bb56ccbd0c2555db9/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.300152 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 973/1969] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:38.304724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.308511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:38.316080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711c74357e1d4532bbcd21e21bca614b, user_id=66026d2c858d489bb56ccbd0c2555db9, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.321040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.333719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c321ac-88a7-4979-967e-3281b0668060 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.343944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 997/1970] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:38 2022] PUT /identity/v3/projects/711c74357e1d4532bbcd21e21bca614b/users/66026d2c858d489bb56ccbd0c2555db9/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:38.345483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.445419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:38.474530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.475049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.475331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.475595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] PATH_INFO: `/v3/users/02a3893c9bc9435d9d65c7c6e9244d5b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.476860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a3893c9bc9435d9d65c7c6e9244d5b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.479649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.492427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720091c9-e68b-4ff0-a110-0c5e4e7af065 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.500586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.501215 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.508059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.508376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.509072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.510982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.530981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 998/1971] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:38.530981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.540653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9ed9-570b-4759-9ab1-53db77cc9525 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.546126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.546725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.547014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.547265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.547929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.549541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.557509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a3893c9bc9435d9d65c7c6e9244d5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:38.560793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 999/1972] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:38.561611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.574072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ca0ad-b33b-40f0-9605-92f19b6bb1ee admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.574248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a3893c9bc9435d9d65c7c6e9244d5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:38.574984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a3893c9bc9435d9d65c7c6e9244d5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:38.575808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a3893c9bc9435d9d65c7c6e9244d5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:38.579132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c1141-a91a-478a-bd53-67efd660fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.579960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1141-a91a-478a-bd53-67efd660fa6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.592418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1141-a91a-478a-bd53-67efd660fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.592810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c1141-a91a-478a-bd53-67efd660fa6e admin admin] PATH_INFO: `/v3/projects/419f0b4d22134a20809fc1a4ffdf99c0/users/a1f862fd25674b099977258abdc6e3d4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.599237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a3893c9bc9435d9d65c7c6e9244d5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:38.618111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c1141-a91a-478a-bd53-67efd660fa6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=419f0b4d22134a20809fc1a4ffdf99c0, user_id=a1f862fd25674b099977258abdc6e3d4, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.621218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c1141-a91a-478a-bd53-67efd660fa6e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.630056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 974/1973] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:38 2022] DELETE /identity/v3/users/02a3893c9bc9435d9d65c7c6e9244d5b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:38.632676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.636476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:38.643845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1000/1974] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:38 2022] PUT /identity/v3/projects/419f0b4d22134a20809fc1a4ffdf99c0/users/a1f862fd25674b099977258abdc6e3d4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:38.644846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13782-eeee-4eef-a3d5-1a53d5e95094 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.645125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13782-eeee-4eef-a3d5-1a53d5e95094 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.645391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b13782-eeee-4eef-a3d5-1a53d5e95094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.664821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:38.686476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-09b13782-eeee-4eef-a3d5-1a53d5e95094 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:38.692019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-09b13782-eeee-4eef-a3d5-1a53d5e95094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:38.754737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beb636-e6cb-4d40-8785-015e36853b25 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:38.782401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1001/1975] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:38.784297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204420-2cae-4e77-b472-7004b045b378 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.785089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204420-2cae-4e77-b472-7004b045b378 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.785509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204420-2cae-4e77-b472-7004b045b378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.825869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-78204420-2cae-4e77-b472-7004b045b378 None None] MFA Rules not processed for user `a1f862fd25674b099977258abdc6e3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:38.827906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-78204420-2cae-4e77-b472-7004b045b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:38.831221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:38.832560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.832840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.833749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] PATH_INFO: `/v3/projects/711c74357e1d4532bbcd21e21bca614b/users/66026d2c858d489bb56ccbd0c2555db9/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:38.836384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711c74357e1d4532bbcd21e21bca614b, user_id=66026d2c858d489bb56ccbd0c2555db9, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:38.845830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:38.863638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 975/1976] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:38 2022] PUT /identity/v3/projects/711c74357e1d4532bbcd21e21bca614b/users/66026d2c858d489bb56ccbd0c2555db9/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:38.865174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:38.884389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:38.932750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:38.967298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1002/1977] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:38.968769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:38.969114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:38.969706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:39.057666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] MFA Rules not processed for user `66026d2c858d489bb56ccbd0c2555db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:39.059209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:39.121416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4be9-f97f-4634-a5c2-7aa08dc51ec0 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:39.141006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:39.142863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:39.142863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:39.143071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:39.224064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1003/1978] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:39.224897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:39.226318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:39.254818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:39.272048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:39.273887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:39.287948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 976/1979] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:39.289129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:39.291027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:39.325121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853c05-bf55-4f98-8ce5-8d0c2b51ef7d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:39.331492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:39.331730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:39.331884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:39.332157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:39.371372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819e8e2-b802-4394-979d-220fd55d4d29 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:39.376011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:39.376702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:39.377033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:39.377312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:39.388231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:39.389718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:39.401423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 977/1980] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:39.405967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:39.407423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:39.418249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1004/1981] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:39.704708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:39.706401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:39.740327 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f504040-7463-484e-adf5-4f4683ba4446 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:39.746193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:39.746850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:39.747131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:39.747398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] PATH_INFO: `/v3/projects/63dabb30106144b99a99defd4faaaa05` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:39.748668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dabb30106144b99a99defd4faaaa05)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:39.750942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:39.810922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dabb30106144b99a99defd4faaaa05', 'request_id': 'req-2ee381c5-a466-4985-8d63-e708155c6226'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:39.815982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:39.822471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dabb30106144b99a99defd4faaaa05', 'request_id': 'req-2ee381c5-a466-4985-8d63-e708155c6226'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:39.836147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dabb30106144b99a99defd4faaaa05', 'request_id': 'req-2ee381c5-a466-4985-8d63-e708155c6226'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:39.849886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] The token cache is being invalidate because project 63dabb30106144b99a99defd4faaaa05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:39.850454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:39.850857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:39.852672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 978/1982] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:39 2022] DELETE /identity/v3/projects/63dabb30106144b99a99defd4faaaa05 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:39.856879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:39.867875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d8c53-087d-4289-923d-1ca9cb0c9ba7 service glance] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:39.935460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:39.936818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:39.936991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:39.937303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] PATH_INFO: `/v3/users/b70700e110e0470aa6a0c913ae2334cf` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:39.938545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70700e110e0470aa6a0c913ae2334cf)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:39.940804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:40.011390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70700e110e0470aa6a0c913ae2334cf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.021890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70700e110e0470aa6a0c913ae2334cf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.023983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:40.037654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70700e110e0470aa6a0c913ae2334cf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.038710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70700e110e0470aa6a0c913ae2334cf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.073888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70700e110e0470aa6a0c913ae2334cf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.080686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1005/1983] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:39 2022] DELETE /identity/v3/users/b70700e110e0470aa6a0c913ae2334cf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:40.553146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:40.555116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:40.569731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee381c5-a466-4985-8d63-e708155c6226 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:40.665322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:40.666300 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:40.666569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:40.666870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] PATH_INFO: `/v3/projects/d9893c7eb5ba4f79aed2c980981a1427` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:40.670232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9893c7eb5ba4f79aed2c980981a1427)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:40.670633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:40.734427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9893c7eb5ba4f79aed2c980981a1427', 'request_id': 'req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.742595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9893c7eb5ba4f79aed2c980981a1427', 'request_id': 'req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.751589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9893c7eb5ba4f79aed2c980981a1427', 'request_id': 'req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.763323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] The token cache is being invalidate because project d9893c7eb5ba4f79aed2c980981a1427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:40.763615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.764879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.766452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 979/1984] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:40 2022] DELETE /identity/v3/projects/d9893c7eb5ba4f79aed2c980981a1427 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:40.770764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:40.772488 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:40.789661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeec572-a312-4157-a650-97c38c56fa26 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:40.858254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:40.859528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:40.859867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:40.860150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] PATH_INFO: `/v3/users/a569a8cd80ea4d05b544bf7292e4e68b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:40.862095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a569a8cd80ea4d05b544bf7292e4e68b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:40.864513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:40.923743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a569a8cd80ea4d05b544bf7292e4e68b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.933367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a569a8cd80ea4d05b544bf7292e4e68b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.940916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a569a8cd80ea4d05b544bf7292e4e68b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.941577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a569a8cd80ea4d05b544bf7292e4e68b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.955746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a569a8cd80ea4d05b544bf7292e4e68b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:40.962920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1006/1985] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:40 2022] DELETE /identity/v3/users/a569a8cd80ea4d05b544bf7292e4e68b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:41.267519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.269420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:41.284391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6e96c-fe0a-49f9-b9da-d3a4495e8d5f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.290266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.292519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:41.361340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:41.381871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.382724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.382996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.383324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] PATH_INFO: `/v3/users/ddf7c304b58040a09b6c9d4fd231db4c` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.384634 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf7c304b58040a09b6c9d4fd231db4c)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.386712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:41.391333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2290c-22ce-4b91-be14-84d5cfe789c2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.396184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.396923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.397295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.397652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] PATH_INFO: `/v3/projects/03b20c5688db4751bb0daa423d15ba68` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.398938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b20c5688db4751bb0daa423d15ba68)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.401113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:41.403837 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:41.450199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf7c304b58040a09b6c9d4fd231db4c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.463902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf7c304b58040a09b6c9d4fd231db4c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.464239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b20c5688db4751bb0daa423d15ba68', 'request_id': 'req-fbfd16f5-e8f3-4392-9cf8-611038032bdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.464672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf7c304b58040a09b6c9d4fd231db4c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.465989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf7c304b58040a09b6c9d4fd231db4c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.474573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b20c5688db4751bb0daa423d15ba68', 'request_id': 'req-fbfd16f5-e8f3-4392-9cf8-611038032bdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.475487 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f27e6e21-904b-4d53-9f5a-f5b2f2946bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf7c304b58040a09b6c9d4fd231db4c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.481136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b20c5688db4751bb0daa423d15ba68', 'request_id': 'req-fbfd16f5-e8f3-4392-9cf8-611038032bdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.496638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] The token cache is being invalidate because project 03b20c5688db4751bb0daa423d15ba68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:41.496638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.498068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 980/1986] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:41 2022] DELETE /identity/v3/users/ddf7c304b58040a09b6c9d4fd231db4c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:41.498156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-fbfd16f5-e8f3-4392-9cf8-611038032bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:41.498156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1007/1987] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:41 2022] DELETE /identity/v3/projects/03b20c5688db4751bb0daa423d15ba68 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:41.503303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.503579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.503959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.507949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcf758-dada-44c7-8329-d3c431f3f5d9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.508227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcf758-dada-44c7-8329-d3c431f3f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.508493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcf758-dada-44c7-8329-d3c431f3f5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.525664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:41.526963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:41.530137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9ddcf758-dada-44c7-8329-d3c431f3f5d9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:41.531950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9ddcf758-dada-44c7-8329-d3c431f3f5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:41.614179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1008/1988] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:41.618353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 981/1989] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:41.620422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acdd74-8173-44be-bc99-1dbd0986dfea None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.620422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acdd74-8173-44be-bc99-1dbd0986dfea None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.620422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acdd74-8173-44be-bc99-1dbd0986dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.634863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.639455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:41.654990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-54acdd74-8173-44be-bc99-1dbd0986dfea None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:41.657421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-54acdd74-8173-44be-bc99-1dbd0986dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:41.680971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1009/1990] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:41.686765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acdd74-8173-44be-bc99-1dbd0986dfea None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.709150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acdd74-8173-44be-bc99-1dbd0986dfea None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.727183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.728093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.731738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.731738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.731738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:41.732158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.735639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:41.762123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1010/1991] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:41.763099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.767338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e088fa-d384-45fe-97b2-0b890199055e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.776177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.777371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.777633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.778230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.782239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ddc76-55fe-40c4-a57a-705e7f4ff516 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.789058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.789860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.790200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.790537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.791377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.793771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:41.801184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.802694 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:41.813038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 982/1992] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:41.827225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1011/1993] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:41 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:41.828429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.838612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4cca-2bdf-4ca6-80b4-cc72c1954d6f service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.874359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:41.903546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.905123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.905608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.906058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.906897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.910417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:41.936388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 983/1994] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:41 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:41.940898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.952366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018e997-85e8-4174-9f12-c31f333c0ae8 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.957362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.957988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.958268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.958536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.959173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.960825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:41.971783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1012/1995] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:41.975955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:41.989373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fe8af-9b40-41fb-b526-7ed347bb354d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:41.994439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953000e-90a2-43a8-ad5a-4d14015057ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:41.995074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953000e-90a2-43a8-ad5a-4d14015057ff admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:41.995353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953000e-90a2-43a8-ad5a-4d14015057ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:41.995617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953000e-90a2-43a8-ad5a-4d14015057ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:41.996698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953000e-90a2-43a8-ad5a-4d14015057ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:41.998085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953000e-90a2-43a8-ad5a-4d14015057ff admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:42.009550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 984/1996] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:42.013918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:42.023816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b503f-837b-4356-a8d2-a278990656ca admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:42.029433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:42.030101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:42.030375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:42.030640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] PATH_INFO: `/v3/projects/c90f76e22c394fb18941e7c422f4f830/users/adff6418c8d54bb9913a5d26b7fa09c0/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:42.046084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90f76e22c394fb18941e7c422f4f830, user_id=adff6418c8d54bb9913a5d26b7fa09c0, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:42.048802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:42.068618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1013/1997] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:42 2022] PUT /identity/v3/projects/c90f76e22c394fb18941e7c422f4f830/users/adff6418c8d54bb9913a5d26b7fa09c0/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:42.073801 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294a469-a158-493b-bc86-5e1a6d7934e0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:42.074091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294a469-a158-493b-bc86-5e1a6d7934e0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:42.074361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294a469-a158-493b-bc86-5e1a6d7934e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:42.093740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2294a469-a158-493b-bc86-5e1a6d7934e0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:42.095383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2294a469-a158-493b-bc86-5e1a6d7934e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:42.118059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:42.120980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:42.128003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:42.184618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 985/1998] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:42.195337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294a469-a158-493b-bc86-5e1a6d7934e0 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:42.215716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afd7c0-9ed3-45e6-ac5c-6c3348935b39 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:42.220791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:42.221438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:42.221713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:42.222038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] PATH_INFO: `/v3/projects/563fbfd9e5294a3c956b087d58b02d0b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:42.223120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] RBAC: Authorizing `identity:delete_project(project_id=563fbfd9e5294a3c956b087d58b02d0b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:42.225118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:42.267933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294a469-a158-493b-bc86-5e1a6d7934e0 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:42.279073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563fbfd9e5294a3c956b087d58b02d0b', 'request_id': 'req-9da09cde-ff75-48e0-b9c6-75d7e719145b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.287990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563fbfd9e5294a3c956b087d58b02d0b', 'request_id': 'req-9da09cde-ff75-48e0-b9c6-75d7e719145b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.294428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563fbfd9e5294a3c956b087d58b02d0b', 'request_id': 'req-9da09cde-ff75-48e0-b9c6-75d7e719145b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.306618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] The token cache is being invalidate because project 563fbfd9e5294a3c956b087d58b02d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:42.306903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.308033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.309989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1014/1999] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:42 2022] DELETE /identity/v3/projects/563fbfd9e5294a3c956b087d58b02d0b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:42.313781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:42.315088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:42.319087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:42.319720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:42.320002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:42.320268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:42.322461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:42.353633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:42.387263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09cde-ff75-48e0-b9c6-75d7e719145b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:42.391363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:42.392045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:42.392683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:42.392844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:42.392946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:42.393208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] PATH_INFO: `/v3/users/66026d2c858d489bb56ccbd0c2555db9` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:42.394324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66026d2c858d489bb56ccbd0c2555db9)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:42.396303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:42.403077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 986/2000] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:42.444859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:42.456813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66026d2c858d489bb56ccbd0c2555db9'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.465477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66026d2c858d489bb56ccbd0c2555db9'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.473275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66026d2c858d489bb56ccbd0c2555db9'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.473912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66026d2c858d489bb56ccbd0c2555db9'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.487167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-496a904e-3413-49d5-a38a-6049507409c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66026d2c858d489bb56ccbd0c2555db9'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:42.496743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1015/2001] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:42 2022] DELETE /identity/v3/users/66026d2c858d489bb56ccbd0c2555db9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:43.094539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.124060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dfc18-97b6-4e1a-baed-a5360994fd86 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.212798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:43.221113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.221440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.221726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] PATH_INFO: `/v3/projects/711c74357e1d4532bbcd21e21bca614b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.223250 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711c74357e1d4532bbcd21e21bca614b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:43.226041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:43.281598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711c74357e1d4532bbcd21e21bca614b', 'request_id': 'req-0e995537-c32b-4e87-9fcf-a436c2dab895'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:43.290031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711c74357e1d4532bbcd21e21bca614b', 'request_id': 'req-0e995537-c32b-4e87-9fcf-a436c2dab895'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:43.295850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711c74357e1d4532bbcd21e21bca614b', 'request_id': 'req-0e995537-c32b-4e87-9fcf-a436c2dab895'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:43.309550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] The token cache is being invalidate because project 711c74357e1d4532bbcd21e21bca614b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:43.309864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:43.310527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0e995537-c32b-4e87-9fcf-a436c2dab895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:43.312147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 987/2002] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:43 2022] DELETE /identity/v3/projects/711c74357e1d4532bbcd21e21bca614b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:43.316996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323786-992a-47d2-8857-99a7290c2c74 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.317522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323786-992a-47d2-8857-99a7290c2c74 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.317522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323786-992a-47d2-8857-99a7290c2c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.337235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-62323786-992a-47d2-8857-99a7290c2c74 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:43.338636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-62323786-992a-47d2-8857-99a7290c2c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:43.398417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1016/2003] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:43.407855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093d32-6aff-44de-b62b-96a9ee220a5e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.408146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093d32-6aff-44de-b62b-96a9ee220a5e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.408416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093d32-6aff-44de-b62b-96a9ee220a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.440539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-04093d32-6aff-44de-b62b-96a9ee220a5e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:43.443969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-04093d32-6aff-44de-b62b-96a9ee220a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:43.453290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 988/2004] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:43.457752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323786-992a-47d2-8857-99a7290c2c74 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.467899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323786-992a-47d2-8857-99a7290c2c74 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.472858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:43.473713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.473989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.474253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.474896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:43.475187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:43.476963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:43.490338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1017/2005] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:43.494829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04093d32-6aff-44de-b62b-96a9ee220a5e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.504546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04093d32-6aff-44de-b62b-96a9ee220a5e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.509242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:43.509951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.510454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.510454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.511013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:43.513015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:43.548486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 989/2006] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:43 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:43.553410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.565088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c8826-b55a-453f-ae4c-2bd6c07f0da3 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.623679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:43.624317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.624590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.624851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.625587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:43.627502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:43.650086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1018/2007] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:43 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:43.655048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.670849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a28b1b-309a-4629-8be7-9fbb734691b9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.677039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:43.677670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.677947 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.678216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.678860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:43.680580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:43.691641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 990/2008] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:43.695567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.705577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20180af-c557-425a-9ba9-45fa767fe499 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.710337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f769f-f73a-45da-b6a6-913882c80015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:43.710942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f769f-f73a-45da-b6a6-913882c80015 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.711223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f769f-f73a-45da-b6a6-913882c80015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.711494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f769f-f73a-45da-b6a6-913882c80015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.712351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f769f-f73a-45da-b6a6-913882c80015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:43.714143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f769f-f73a-45da-b6a6-913882c80015 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:43.725585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1019/2009] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:43.730055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.741185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc29b54-92ae-4612-8cd9-f71e748ca42c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.747632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:43.748349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.748677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.749173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] PATH_INFO: `/v3/projects/d15aa4b75f904c7099197981e8806142/users/8270d7ddf78f4326bb813236e1d25cb4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.759737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:43.782707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15aa4b75f904c7099197981e8806142, user_id=8270d7ddf78f4326bb813236e1d25cb4, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:43.786022 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:43.802345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 991/2010] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:43 2022] PUT /identity/v3/projects/d15aa4b75f904c7099197981e8806142/users/8270d7ddf78f4326bb813236e1d25cb4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:43.813651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9da316-95e4-45a6-b0e1-6b04c3bd7b30 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:43.813914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9da316-95e4-45a6-b0e1-6b04c3bd7b30 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:43.814484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9da316-95e4-45a6-b0e1-6b04c3bd7b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:43.843335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8e9da316-95e4-45a6-b0e1-6b04c3bd7b30 None None] MFA Rules not processed for user `8270d7ddf78f4326bb813236e1d25cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:43.844577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8e9da316-95e4-45a6-b0e1-6b04c3bd7b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:43.853929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:43.919507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1020/2011] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:43.924614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:43.993176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910fdc-182b-4a48-a86d-68750c6cef1f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:43.999404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.000310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.001008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.001263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.001992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.005169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.042946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 992/2012] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:43 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:44.047316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9da316-95e4-45a6-b0e1-6b04c3bd7b30 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:44.073025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9da316-95e4-45a6-b0e1-6b04c3bd7b30 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:44.152858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.154017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.154452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.154977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.155800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.158103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.192556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1021/2013] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:44 2022] POST /identity/v3/users => generated 303 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:44.200867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:44.213471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dc40-c9ee-4ac9-8cf5-e6d09abb0030 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:44.220530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.221340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.221725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.222098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.223560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.224599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.244258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 993/2014] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:44.247078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:44.264648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd9a6-ce65-4bb0-80f1-3b01dc990999 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:44.288005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28868b8-f6fc-49af-9621-d6f56bcf0ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.288602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28868b8-f6fc-49af-9621-d6f56bcf0ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.289482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28868b8-f6fc-49af-9621-d6f56bcf0ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.289809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28868b8-f6fc-49af-9621-d6f56bcf0ee6 admin admin] PATH_INFO: `/v3/projects/60351b437108460a8a3c4df012b26658/users/16edd06431df489eaa519b97dc05df54/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.333921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28868b8-f6fc-49af-9621-d6f56bcf0ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60351b437108460a8a3c4df012b26658, user_id=16edd06431df489eaa519b97dc05df54, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.336998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28868b8-f6fc-49af-9621-d6f56bcf0ee6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.364029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1022/2015] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:44 2022] PUT /identity/v3/projects/60351b437108460a8a3c4df012b26658/users/16edd06431df489eaa519b97dc05df54/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:44.383619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:44.397005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe655bb-5ce0-4d79-bdbc-65c5a15e0b3a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:44.411034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.411361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.411640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.487167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] MFA Rules not processed for user `adff6418c8d54bb9913a5d26b7fa09c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:44.492056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:44.545066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.545866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.546149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.546465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.547890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.549757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.580661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 994/2016] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:44.581611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:44.605884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80451430-e92e-4d98-a919-9d2b8de03c44 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:44.616935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c4a55-efa0-4f1d-9f0a-9755d4fa2b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.619017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c4a55-efa0-4f1d-9f0a-9755d4fa2b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.620533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c4a55-efa0-4f1d-9f0a-9755d4fa2b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.620849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c4a55-efa0-4f1d-9f0a-9755d4fa2b51 admin admin] PATH_INFO: `/v3/projects/60351b437108460a8a3c4df012b26658/users/16edd06431df489eaa519b97dc05df54/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.623314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c4a55-efa0-4f1d-9f0a-9755d4fa2b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60351b437108460a8a3c4df012b26658, user_id=16edd06431df489eaa519b97dc05df54, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.626018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c4a55-efa0-4f1d-9f0a-9755d4fa2b51 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.650623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1023/2017] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:44.662098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 995/2018] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:44 2022] PUT /identity/v3/projects/60351b437108460a8a3c4df012b26658/users/16edd06431df489eaa519b97dc05df54/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:44.671549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:44.673825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.674316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.674711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:44.674963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.693625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:44.711565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] MFA Rules not processed for user `16edd06431df489eaa519b97dc05df54`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:44.713345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:44.763215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:44.776638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84d1dc-7906-42f5-acb8-2d03c1a867d3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:44.817572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 996/2019] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:44.822564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:44.825005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:44.842829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8f92d-d161-4817-856a-95e1432f1da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.843525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8f92d-d161-4817-856a-95e1432f1da6 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.843836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8f92d-d161-4817-856a-95e1432f1da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.844093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8f92d-d161-4817-856a-95e1432f1da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.895673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdb76a-6469-4baa-bb83-817e4b4278cd None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:44.899277 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:44.899976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:44.900471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:44.900849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:44.912822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8f92d-d161-4817-856a-95e1432f1da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.913034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:44.914604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.914784 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8f92d-d161-4817-856a-95e1432f1da6 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:44.925707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 997/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:44.927365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1024/2021] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:45.028927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:45.053580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc42592-d003-4fcc-87b9-9e5f1139e141 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:45.065738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03297cec-438e-4ebf-a3a1-d10c4d10c167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:45.066661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03297cec-438e-4ebf-a3a1-d10c4d10c167 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:45.068074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03297cec-438e-4ebf-a3a1-d10c4d10c167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:45.068074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03297cec-438e-4ebf-a3a1-d10c4d10c167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:45.163043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03297cec-438e-4ebf-a3a1-d10c4d10c167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:45.164794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03297cec-438e-4ebf-a3a1-d10c4d10c167 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:45.180987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 998/2022] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:46.582923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b1f5-1d58-498f-905f-b0da1e267447 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:46.583461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b1f5-1d58-498f-905f-b0da1e267447 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:46.583461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b1f5-1d58-498f-905f-b0da1e267447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:46.612543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f077b1f5-1d58-498f-905f-b0da1e267447 None None] MFA Rules not processed for user `adff6418c8d54bb9913a5d26b7fa09c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:46.613708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f077b1f5-1d58-498f-905f-b0da1e267447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:46.622763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1025/2023] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:48.167349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74c83-57e3-49be-ac8e-f6433697c075 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:48.169303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74c83-57e3-49be-ac8e-f6433697c075 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:48.169855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74c83-57e3-49be-ac8e-f6433697c075 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:48.172323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 999/2024] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 12:59:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:59:48.201145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:48.201692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:48.201692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:48.241610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] MFA Rules not processed for user `5d89f4bf4bcb4b408a693a68edf87878`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:48.242992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:48.273469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc74c83-57e3-49be-ac8e-f6433697c075 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:48.275288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2dc74c83-57e3-49be-ac8e-f6433697c075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:48.370588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1026/2025] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 12:59:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:48.386987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:48.389517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:48.390490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc74c83-57e3-49be-ac8e-f6433697c075 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:48.396160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:48.397369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:48.397772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:48.398112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] PATH_INFO: `/v3/users/05636960e9eb4dccbf9784871f79b774` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:48.399868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05636960e9eb4dccbf9784871f79b774)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:48.400879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:48.403572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:48.408227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc54e4-595f-49db-b2cd-6adde4ff9fab None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:48.416255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:48.417248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:48.417765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:48.418026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:48.428971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:48.430980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:48.447087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1027/2026] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:48.449641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:48.505215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05636960e9eb4dccbf9784871f79b774'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.514299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05636960e9eb4dccbf9784871f79b774'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.514993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05636960e9eb4dccbf9784871f79b774'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.515862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05636960e9eb4dccbf9784871f79b774'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.523446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e341c8d7-b31e-4ab4-a893-eadb41842e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05636960e9eb4dccbf9784871f79b774'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.541819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1000/2027] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:48 2022] DELETE /identity/v3/users/05636960e9eb4dccbf9784871f79b774 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:48.723021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:48.738634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb18e-bba7-44fa-b19c-bb4605049acd service placement] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:48.804265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:48.804973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:48.805310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:48.805639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] PATH_INFO: `/v3/projects/edf77dc928684844b56bde0d546e5db5` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:48.807187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf77dc928684844b56bde0d546e5db5)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:48.809171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:48.866312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf77dc928684844b56bde0d546e5db5', 'request_id': 'req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.878443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf77dc928684844b56bde0d546e5db5', 'request_id': 'req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.885313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf77dc928684844b56bde0d546e5db5', 'request_id': 'req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.898938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] The token cache is being invalidate because project edf77dc928684844b56bde0d546e5db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:48.899230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.900002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bed9ea7-3c0f-4c73-a33d-215b5510a8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:48.904875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1028/2028] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:48 2022] DELETE /identity/v3/projects/edf77dc928684844b56bde0d546e5db5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:48.906851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987d5df-e835-4f71-90d6-1b4312505ac7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:48.907157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987d5df-e835-4f71-90d6-1b4312505ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:48.907404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987d5df-e835-4f71-90d6-1b4312505ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:48.930954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e987d5df-e835-4f71-90d6-1b4312505ac7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:48.934715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e987d5df-e835-4f71-90d6-1b4312505ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:49.037290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1001/2029] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:49.045466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ae88d-9a1e-4045-940c-94c768fe7501 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.045753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ae88d-9a1e-4045-940c-94c768fe7501 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.046085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ae88d-9a1e-4045-940c-94c768fe7501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.072878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2b3ae88d-9a1e-4045-940c-94c768fe7501 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:49.074095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2b3ae88d-9a1e-4045-940c-94c768fe7501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:49.083742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1029/2030] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:49.087776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987d5df-e835-4f71-90d6-1b4312505ac7 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.100157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987d5df-e835-4f71-90d6-1b4312505ac7 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.105698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.106827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.107381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.107861 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.108800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:49.110068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.112653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.128748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1002/2031] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:49.133093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ae88d-9a1e-4045-940c-94c768fe7501 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.144931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ae88d-9a1e-4045-940c-94c768fe7501 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.161358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.163241 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.163519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.164928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.165714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.170521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.208638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1030/2032] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:49 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:49.213012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.226541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2580e0-3e72-41a9-9989-85ef56d5df6e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.245981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.247988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:49.289730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.290358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.290765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.291193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.292117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.294043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.314344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:49.323922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1003/2033] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:49 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:49.328179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.328534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2eed-0534-4bc7-9ea9-10431ce03f15 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.342708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.343380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.343657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.343951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] PATH_INFO: `/v3/users/8270d7ddf78f4326bb813236e1d25cb4` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.347206 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8270d7ddf78f4326bb813236e1d25cb4)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.347568 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e1895-9283-4cf5-a0d8-c7ab7a3bbeef admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.349189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.354398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.355013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.355295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.355566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.356246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.357838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.359895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:49.375627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1004/2034] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:49.377483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.390751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4728f92-4be3-4bac-99f0-4095584272f0 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.396091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.396908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.397158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.397462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.398495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.402073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.418919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8270d7ddf78f4326bb813236e1d25cb4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:49.423307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1005/2035] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:49.428181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.448722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8270d7ddf78f4326bb813236e1d25cb4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:49.452732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6eca8-f43d-4f88-9ff8-7fc72aca5a00 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.457772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8270d7ddf78f4326bb813236e1d25cb4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:49.459132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8270d7ddf78f4326bb813236e1d25cb4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:49.460697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a56e4-a514-4181-b63f-8ce8d3491912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.464455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a56e4-a514-4181-b63f-8ce8d3491912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.464767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a56e4-a514-4181-b63f-8ce8d3491912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.465207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a56e4-a514-4181-b63f-8ce8d3491912 admin admin] PATH_INFO: `/v3/projects/b7ab5cf04dd941ff9453137b8bdab0f3/users/299a4768e9014d93a6031e8b532c9b9b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.480479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-43f66ef6-dfd2-4558-9573-342c08b9fc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8270d7ddf78f4326bb813236e1d25cb4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:49.491286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1031/2036] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:49 2022] DELETE /identity/v3/users/8270d7ddf78f4326bb813236e1d25cb4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:49.494801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.495084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.495504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.496370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a56e4-a514-4181-b63f-8ce8d3491912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ab5cf04dd941ff9453137b8bdab0f3, user_id=299a4768e9014d93a6031e8b532c9b9b, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.499180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a56e4-a514-4181-b63f-8ce8d3491912 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.519512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:49.521719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:49.524175 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1006/2037] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:49 2022] PUT /identity/v3/projects/b7ab5cf04dd941ff9453137b8bdab0f3/users/299a4768e9014d93a6031e8b532c9b9b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:49.536327 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.536327 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.536593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.574426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] MFA Rules not processed for user `299a4768e9014d93a6031e8b532c9b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:49.575804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:49.624238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1032/2038] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:49.636814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.638587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:49.689213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1007/2039] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:59:49.691135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.693141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:49.711260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979178a-78b0-410f-8e2b-6412f7137b55 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.719182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.720775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.721324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809217bf-83ff-4327-ac03-6b4b90fe093b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.721543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.722011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.722975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.725639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.726390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.727331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.727614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.728008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.742995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.745839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.759065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1033/2040] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:59:49.779969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.784079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1008/2041] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:49 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:49.792985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b23e19-1447-4215-8ddb-0c9053aca832 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.806897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:49.862847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.863571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.863968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.864290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.864980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.866951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.906123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1034/2042] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:49 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:49.909916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.921608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab93dbf-5721-4c93-afb7-be3cd16d6b58 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.940183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.940853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.941130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.941410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.942062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.943721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:49.956660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1009/2043] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:49.960902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:49.974181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c403db-c9e7-4d03-bb71-a6d18f2d4f55 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:49.979948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:49.981285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:49.981285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:49.981509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] PATH_INFO: `/v3/projects/c10802e22dc843e9b358b64bd5b7ca9b/users/6dea204d660a4ac2bb8c8b8c0533fcf4/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:49.997120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10802e22dc843e9b358b64bd5b7ca9b, user_id=6dea204d660a4ac2bb8c8b8c0533fcf4, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:49.999838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:50.016706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1035/2044] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:49 2022] PUT /identity/v3/projects/c10802e22dc843e9b358b64bd5b7ca9b/users/6dea204d660a4ac2bb8c8b8c0533fcf4/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:50.020916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:50.033632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92bcec-a43b-479f-9c0f-c41828d677c4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:50.066234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:50.068041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:50.139356 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:50.140118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:50.140459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:50.140798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:50.141520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:50.143308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:50.152070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17829188-c234-4736-8c7f-0b5d4ccddf44 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:50.156812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:50.157450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:50.157732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:50.158334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] PATH_INFO: `/v3/projects/d15aa4b75f904c7099197981e8806142` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:50.158978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1010/2045] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:50.159588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15aa4b75f904c7099197981e8806142)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:50.160422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:50.162240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:50.175146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f902d-cbf0-44f2-a238-0850e4bf1ab1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:50.185332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ce8e5-e167-4534-88b5-9205708ccc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:50.186506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce8e5-e167-4534-88b5-9205708ccc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:50.186797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce8e5-e167-4534-88b5-9205708ccc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:50.188598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce8e5-e167-4534-88b5-9205708ccc4b admin admin] PATH_INFO: `/v3/projects/c10802e22dc843e9b358b64bd5b7ca9b/users/6dea204d660a4ac2bb8c8b8c0533fcf4/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:50.191926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ce8e5-e167-4534-88b5-9205708ccc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10802e22dc843e9b358b64bd5b7ca9b, user_id=6dea204d660a4ac2bb8c8b8c0533fcf4, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:50.194788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ce8e5-e167-4534-88b5-9205708ccc4b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:50.203339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:50.208798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1011/2046] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:50 2022] PUT /identity/v3/projects/c10802e22dc843e9b358b64bd5b7ca9b/users/6dea204d660a4ac2bb8c8b8c0533fcf4/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:50.245586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:50.246092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:50.246257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:50.253843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15aa4b75f904c7099197981e8806142', 'request_id': 'req-de0cfa25-cd75-425e-9b30-36e947f92e04'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.282732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15aa4b75f904c7099197981e8806142', 'request_id': 'req-de0cfa25-cd75-425e-9b30-36e947f92e04'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.299148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] MFA Rules not processed for user `6dea204d660a4ac2bb8c8b8c0533fcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:50.300912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:50.304334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15aa4b75f904c7099197981e8806142', 'request_id': 'req-de0cfa25-cd75-425e-9b30-36e947f92e04'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.323191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] The token cache is being invalidate because project d15aa4b75f904c7099197981e8806142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:50.324046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.332831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.335087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1036/2047] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:50 2022] DELETE /identity/v3/projects/d15aa4b75f904c7099197981e8806142 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:50.338944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:50.343165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:50.372051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:50.423840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1012/2048] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:50.447563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:50.449113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:50.464464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cfa25-cd75-425e-9b30-36e947f92e04 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:50.469313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:50.470314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:50.470591 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:50.471125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] PATH_INFO: `/v3/users/16edd06431df489eaa519b97dc05df54` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:50.471999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16edd06431df489eaa519b97dc05df54)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:50.474371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:50.527357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd58b4-8aed-4fa4-8831-36a3fb0a899b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:50.532339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66b4ee-316f-4674-8b21-4761e4981ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:50.532962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b4ee-316f-4674-8b21-4761e4981ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:50.533235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b4ee-316f-4674-8b21-4761e4981ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:50.533497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66b4ee-316f-4674-8b21-4761e4981ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:50.535360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2c66b4ee-316f-4674-8b21-4761e4981ef9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:50.542240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16edd06431df489eaa519b97dc05df54'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.558908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16edd06431df489eaa519b97dc05df54'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.569879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16edd06431df489eaa519b97dc05df54'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.570658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16edd06431df489eaa519b97dc05df54'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.588518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16edd06431df489eaa519b97dc05df54'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:50.600016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1037/2049] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:50 2022] DELETE /identity/v3/users/16edd06431df489eaa519b97dc05df54 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:50.627338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66b4ee-316f-4674-8b21-4761e4981ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:50.629734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66b4ee-316f-4674-8b21-4761e4981ef9 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:50.653622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1013/2050] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:51.004847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.006526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:51.111955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9545224-e0b1-4498-a463-775697332f9a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.118210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.119538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.120051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.120303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] PATH_INFO: `/v3/projects/60351b437108460a8a3c4df012b26658` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.122133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60351b437108460a8a3c4df012b26658)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.124576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:51.182339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:51.222922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60351b437108460a8a3c4df012b26658', 'request_id': 'req-e7a0631e-f263-48f6-b202-321a263ab249'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:51.233680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60351b437108460a8a3c4df012b26658', 'request_id': 'req-e7a0631e-f263-48f6-b202-321a263ab249'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:51.240914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60351b437108460a8a3c4df012b26658', 'request_id': 'req-e7a0631e-f263-48f6-b202-321a263ab249'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:51.253769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] The token cache is being invalidate because project 60351b437108460a8a3c4df012b26658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:51.254133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:51.254805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7a0631e-f263-48f6-b202-321a263ab249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:51.256622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1038/2051] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:51 2022] DELETE /identity/v3/projects/60351b437108460a8a3c4df012b26658 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:51.261899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4657-fc25-4860-8614-8ab22ffecf74 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.262425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4657-fc25-4860-8614-8ab22ffecf74 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.262557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b4657-fc25-4860-8614-8ab22ffecf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.284382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-679b4657-fc25-4860-8614-8ab22ffecf74 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:51.286004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-679b4657-fc25-4860-8614-8ab22ffecf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:51.326589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:51.354308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1014/2052] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:51.363640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b242-a14b-4cab-a7d9-287ef7d16fe3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.363974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b242-a14b-4cab-a7d9-287ef7d16fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.364224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678b242-a14b-4cab-a7d9-287ef7d16fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.385360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0678b242-a14b-4cab-a7d9-287ef7d16fe3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:51.386584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0678b242-a14b-4cab-a7d9-287ef7d16fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:51.395070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1039/2053] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:51.399563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b4657-fc25-4860-8614-8ab22ffecf74 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.409563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b4657-fc25-4860-8614-8ab22ffecf74 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.414240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.416633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.416633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.416633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.416633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:51.416633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.427053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:51.449752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1015/2054] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:59:51.454823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b242-a14b-4cab-a7d9-287ef7d16fe3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.467748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678b242-a14b-4cab-a7d9-287ef7d16fe3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.473412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.475637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.476182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.476527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.477295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.479574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:51.517403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1040/2055] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:51 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:51.518782 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.531868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aba745-b13b-4898-8d47-7e4a6aef2b29 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.611159 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.612340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.612458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.612731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.614950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.615351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:51.656627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1016/2056] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:51 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:51.661112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.671639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3faff-5b11-45b7-8757-e08b6cf20065 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.676467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.677083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.677357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.677624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.678286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.679909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:51.690664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1041/2057] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:51.694720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.705774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb264-f523-4be6-b824-9a943521170b admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.710760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb2872-5011-489c-a327-ea524b77fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.711381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2872-5011-489c-a327-ea524b77fa6f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.711659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2872-5011-489c-a327-ea524b77fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.711964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb2872-5011-489c-a327-ea524b77fa6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.712706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb2872-5011-489c-a327-ea524b77fa6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.714326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb2872-5011-489c-a327-ea524b77fa6f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:51.726292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1017/2058] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:51.730388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.743792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c3bac-8954-415b-9e51-c7094bb88c4c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.749025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.749734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.750014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.750284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] PATH_INFO: `/v3/projects/7b9246751f9f4623a416f0fcb0540dbd/users/492026473ae74e569734481980498501/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.767417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9246751f9f4623a416f0fcb0540dbd, user_id=492026473ae74e569734481980498501, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.770152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:51.785452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1042/2059] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:51 2022] PUT /identity/v3/projects/7b9246751f9f4623a416f0fcb0540dbd/users/492026473ae74e569734481980498501/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:51.796315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaee1-1bdf-41da-a250-6f8309787aba None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.796595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaee1-1bdf-41da-a250-6f8309787aba None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.796859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eaee1-1bdf-41da-a250-6f8309787aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.827878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-492eaee1-1bdf-41da-a250-6f8309787aba None None] MFA Rules not processed for user `492026473ae74e569734481980498501`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:51.829104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-492eaee1-1bdf-41da-a250-6f8309787aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:51.905262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1018/2060] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:51.914268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:51.982807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad358f6b-2a67-4ff1-8a76-ec14572883e9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:51.988160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:51.989168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:51.989168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:51.989398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:51.989979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:51.991931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:52.027316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1043/2061] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:51 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:52.028520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eaee1-1bdf-41da-a250-6f8309787aba None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:52.040050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eaee1-1bdf-41da-a250-6f8309787aba None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:52.083583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:52.110566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:52.111331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:52.111604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:52.111913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:52.112655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:52.114614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:52.136274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1019/2062] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:52 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:52.141876 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:52.153547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6168-19fa-424c-a152-bfaa5808dd5d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:52.164693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:52.165839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:52.168199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:52.168936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:52.169739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:52.171810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:52.186339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1044/2063] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:52.190228 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:52.202444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15757d49-44fa-4be8-b4b5-76b99f72a736 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:52.208598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:52.209540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:52.210035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:52.210404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] PATH_INFO: `/v3/projects/98265a217bb84685855e5a76beb6876b/users/ca4090fbf6da4068831d284b3e832499/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:52.233400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98265a217bb84685855e5a76beb6876b, user_id=ca4090fbf6da4068831d284b3e832499, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:52.236332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:52.259336 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1020/2064] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:52 2022] PUT /identity/v3/projects/98265a217bb84685855e5a76beb6876b/users/ca4090fbf6da4068831d284b3e832499/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:52.263449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:52.276220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e2673-b7e4-41e1-94bb-63a2b6eae7ec admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:52.312500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:52.358515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee76b0-9f8c-46d3-9b80-61c6a4f8c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:52.359481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee76b0-9f8c-46d3-9b80-61c6a4f8c3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:52.359790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee76b0-9f8c-46d3-9b80-61c6a4f8c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:52.360054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee76b0-9f8c-46d3-9b80-61c6a4f8c3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:52.360701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee76b0-9f8c-46d3-9b80-61c6a4f8c3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:52.362479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee76b0-9f8c-46d3-9b80-61c6a4f8c3e3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:52.374316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1045/2065] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:52.378367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:52.390221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec846f1-a5f1-4262-99c1-7565a827b477 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:52.396293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:52.396973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:52.397298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:52.397754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] PATH_INFO: `/v3/projects/98265a217bb84685855e5a76beb6876b/users/ca4090fbf6da4068831d284b3e832499/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:52.400062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=98265a217bb84685855e5a76beb6876b, user_id=ca4090fbf6da4068831d284b3e832499, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:52.403046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:52.416100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1021/2066] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:52 2022] PUT /identity/v3/projects/98265a217bb84685855e5a76beb6876b/users/ca4090fbf6da4068831d284b3e832499/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:52.429453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:52.429722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:52.430534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:52.485823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] MFA Rules not processed for user `ca4090fbf6da4068831d284b3e832499`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:52.487192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:52.558637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1046/2067] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:52.570215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:52.572085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:52.638116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c30d5-7b12-42e7-b55a-29a4f28c1cbe admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:52.643142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:52.643786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:52.644066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:52.644333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:52.707362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:52.709188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:52.719985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1022/2068] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:53.534165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:53.535799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:53.548580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c296fc-427c-49ad-a352-cd05bead5af2 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:53.552754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a13b1f-2682-4f33-9d1c-5ace80430d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:53.553369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a13b1f-2682-4f33-9d1c-5ace80430d5c service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:53.553644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a13b1f-2682-4f33-9d1c-5ace80430d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:53.553991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a13b1f-2682-4f33-9d1c-5ace80430d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:53.556603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-95a13b1f-2682-4f33-9d1c-5ace80430d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:53.635200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a13b1f-2682-4f33-9d1c-5ace80430d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:53.636838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a13b1f-2682-4f33-9d1c-5ace80430d5c service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:53.646991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1047/2069] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:56.486216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:56.487786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:56.536053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:56.576483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a337b-22d4-473f-b193-63b2f659af9d service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:56.576483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:56.576711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:56.576914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:56.577221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] PATH_INFO: `/v3/users/5f70c5e8b637437f832d701dd4352275` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:56.578386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f70c5e8b637437f832d701dd4352275)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:56.580439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:56.637099 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f70c5e8b637437f832d701dd4352275'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:56.648235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f70c5e8b637437f832d701dd4352275'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:56.649080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f70c5e8b637437f832d701dd4352275'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:56.649727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f70c5e8b637437f832d701dd4352275'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:56.662098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f70c5e8b637437f832d701dd4352275'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:56.680100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1023/2070] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:56 2022] DELETE /identity/v3/users/5f70c5e8b637437f832d701dd4352275 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:56.684764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:56.685157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:56.685349 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:56.704503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:56.705679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:56.751503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:56.770735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1048/2071] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:56.780950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:56.782587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:56.841308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659da78-95f5-4941-a5e8-173d996bdbde admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:56.845317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:56.845940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:56.846218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:56.846486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:56.855547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:56.857007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:56.866343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1024/2072] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:57.100978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:57.102748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:57.172000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc28025-8f2b-49bf-ad83-53fc194b03d0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:57.176718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:57.177802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:57.178373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:57.178647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:57.181766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:57.182575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:57.184564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:57.233083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563b2e-c7ba-44a0-9fdf-c21849f38eb4 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:57.245459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:57.246218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:57.246493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:57.246754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] PATH_INFO: `/v3/projects/511e216942ac464686fdd35d48f69293` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:57.247955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=511e216942ac464686fdd35d48f69293)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:57.249854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:57.283320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:57.284967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:57.297080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1049/2073] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:59:57.305023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511e216942ac464686fdd35d48f69293', 'request_id': 'req-7859e1a9-6138-424a-b68c-1a05081121f1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.315528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511e216942ac464686fdd35d48f69293', 'request_id': 'req-7859e1a9-6138-424a-b68c-1a05081121f1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.318342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:57.325406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511e216942ac464686fdd35d48f69293', 'request_id': 'req-7859e1a9-6138-424a-b68c-1a05081121f1'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.340240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] The token cache is being invalidate because project 511e216942ac464686fdd35d48f69293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:57.340529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.341192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.342849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1025/2074] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:57 2022] DELETE /identity/v3/projects/511e216942ac464686fdd35d48f69293 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:59:57.347397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:57.359754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec9c01-7de6-4a25-9f97-51ddbe40ca4a service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:57.443817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:57.443817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:57.444112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:57.444495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] PATH_INFO: `/v3/users/c8e86e4d39ec4a76b623cc23d7e565d1` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:57.448962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e86e4d39ec4a76b623cc23d7e565d1)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:57.451129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:57.534834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:57.547454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e86e4d39ec4a76b623cc23d7e565d1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.563308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e86e4d39ec4a76b623cc23d7e565d1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.576063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e86e4d39ec4a76b623cc23d7e565d1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.576950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e86e4d39ec4a76b623cc23d7e565d1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.604160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b0ba7353-1c0f-498e-866a-9942d36e64f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e86e4d39ec4a76b623cc23d7e565d1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:57.641311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1050/2075] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 12:59:57 2022] DELETE /identity/v3/users/c8e86e4d39ec4a76b623cc23d7e565d1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:58.011795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.013412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:58.026789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859e1a9-6138-424a-b68c-1a05081121f1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.089157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.089965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.090255 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.090515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] PATH_INFO: `/v3/projects/0482cd8bcc4341bcb447f1f876e5981d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.091687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0482cd8bcc4341bcb447f1f876e5981d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.093689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.147044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0482cd8bcc4341bcb447f1f876e5981d', 'request_id': 'req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:58.156609 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0482cd8bcc4341bcb447f1f876e5981d', 'request_id': 'req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:58.162855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0482cd8bcc4341bcb447f1f876e5981d', 'request_id': 'req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:58.177935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] The token cache is being invalidate because project 0482cd8bcc4341bcb447f1f876e5981d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:59:58.178230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:58.179241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5f45939f-79e9-4f9c-978f-1aaa9bdb5e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:59:58.181469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1026/2076] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 12:59:58 2022] DELETE /identity/v3/projects/0482cd8bcc4341bcb447f1f876e5981d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:58.187607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22189c6-be6e-4af5-8321-5588d32aebfb None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.188144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22189c6-be6e-4af5-8321-5588d32aebfb None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.188144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22189c6-be6e-4af5-8321-5588d32aebfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.211490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e22189c6-be6e-4af5-8321-5588d32aebfb None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:58.212934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e22189c6-be6e-4af5-8321-5588d32aebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:58.278366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1051/2077] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:58.286365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94e71-eb59-4662-ab1f-70ed8c6f4e1e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.286652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94e71-eb59-4662-ab1f-70ed8c6f4e1e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.286923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c94e71-eb59-4662-ab1f-70ed8c6f4e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.308954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-96c94e71-eb59-4662-ab1f-70ed8c6f4e1e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:58.310168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-96c94e71-eb59-4662-ab1f-70ed8c6f4e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:58.318002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1027/2078] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:58.322316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22189c6-be6e-4af5-8321-5588d32aebfb None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.332379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22189c6-be6e-4af5-8321-5588d32aebfb None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.337092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.337763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.338043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.338321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.338945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:59:58.339266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.340995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.353312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1052/2079] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 12:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:59:58.357883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94e71-eb59-4662-ab1f-70ed8c6f4e1e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.367136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c94e71-eb59-4662-ab1f-70ed8c6f4e1e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.371865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.372461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.372737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.373004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.373635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.375534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.405678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1028/2080] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:58 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:59:58.410118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.420764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60cbb0-dd41-4b73-8eb0-41e392a6c75b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.486815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.487627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.487934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.488196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.488810 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.490726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.517341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1053/2081] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:58 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:58.522101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.535038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f3ab4-1fd4-4104-ace6-aafae0c75f44 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.540820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.541429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.541700 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.541969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.543050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.544750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.554989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1029/2082] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:58.559304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.569725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d42c94-8b4d-48db-a6e9-e693ea3b3e97 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.574783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd004912-de0b-4c69-8016-5fa13cf45be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.575374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd004912-de0b-4c69-8016-5fa13cf45be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.575648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd004912-de0b-4c69-8016-5fa13cf45be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.575944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd004912-de0b-4c69-8016-5fa13cf45be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.576581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd004912-de0b-4c69-8016-5fa13cf45be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.578244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd004912-de0b-4c69-8016-5fa13cf45be1 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.588853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1054/2083] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:58.593038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.603644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1667d-18c8-4256-94bb-c4016737fbb3 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.610038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.610691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.610966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.611232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] PATH_INFO: `/v3/projects/704e069e2c8d404da7d0de87e1c6f01a/users/42df069f3e6842208d1a07b9a2c1e05d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.628232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=704e069e2c8d404da7d0de87e1c6f01a, user_id=42df069f3e6842208d1a07b9a2c1e05d, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.630907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.647020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1030/2084] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:58 2022] PUT /identity/v3/projects/704e069e2c8d404da7d0de87e1c6f01a/users/42df069f3e6842208d1a07b9a2c1e05d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:58.657636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872152-c8bc-4210-b803-f286c788691c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.657914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872152-c8bc-4210-b803-f286c788691c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.658180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af872152-c8bc-4210-b803-f286c788691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.687567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-af872152-c8bc-4210-b803-f286c788691c None None] MFA Rules not processed for user `42df069f3e6842208d1a07b9a2c1e05d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:58.688806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-af872152-c8bc-4210-b803-f286c788691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:58.698869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:58.771789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1055/2085] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:58.776575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.791827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:58.868191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e327-6d07-4335-8150-94d89b1e8da9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:58.874589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:58.875217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:58.875495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:58.875826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:58.876478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:58.878806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:58.923580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1031/2086] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:58 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:58.927843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af872152-c8bc-4210-b803-f286c788691c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:58.948469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af872152-c8bc-4210-b803-f286c788691c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.024429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.025136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.025415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.025685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.026328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.028504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.053307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1056/2087] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:58 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:59.058277 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.069258 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa0734-dc34-4318-b44f-7dae575b4312 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.073913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.074520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.074809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.075179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.075898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.077510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.089254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1032/2088] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:59.093806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.105048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59ceae-da7e-49b8-961c-61c63d953de0 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.110369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea875032-3049-4c54-8a05-7a198532a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.111252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875032-3049-4c54-8a05-7a198532a60b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.111527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875032-3049-4c54-8a05-7a198532a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.111871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875032-3049-4c54-8a05-7a198532a60b admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.114005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea875032-3049-4c54-8a05-7a198532a60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.115959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea875032-3049-4c54-8a05-7a198532a60b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.128036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1057/2089] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:59:59.133643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.145628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402f7dc-b3f1-4362-9f82-01a7677dd85c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.151337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.152794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.153080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.153392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] PATH_INFO: `/v3/projects/eaa97d6f08be4e559f9687aeec3335bb/users/1ddddbd0bf724b5f9311cfab70b4a66e/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.179021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa97d6f08be4e559f9687aeec3335bb, user_id=1ddddbd0bf724b5f9311cfab70b4a66e, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.183478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.199891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1033/2090] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:59 2022] PUT /identity/v3/projects/eaa97d6f08be4e559f9687aeec3335bb/users/1ddddbd0bf724b5f9311cfab70b4a66e/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:59.211689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992197-a101-4ee2-91f5-b0e81973995c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.212220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992197-a101-4ee2-91f5-b0e81973995c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.212307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a992197-a101-4ee2-91f5-b0e81973995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.241696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7a992197-a101-4ee2-91f5-b0e81973995c None None] MFA Rules not processed for user `1ddddbd0bf724b5f9311cfab70b4a66e`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:59.243165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7a992197-a101-4ee2-91f5-b0e81973995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:59.313058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1058/2091] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:59.320770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.382715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc571aed-b51c-458a-8d24-05eecc511f2c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.388102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.388694 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.388970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.389234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.389857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.391780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.426239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1034/2092] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 12:59:59 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:59.431212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992197-a101-4ee2-91f5-b0e81973995c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.473965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a992197-a101-4ee2-91f5-b0e81973995c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.505935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:59.557999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.559736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.560055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.560396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.561055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.563238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.589397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1059/2093] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 12:59:59 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:59:59.594102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.606377 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d659ee-294f-4bb1-b296-37a189cf6f61 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.611426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.612100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.612524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.612819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.613504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.615154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.628253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1035/2094] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:59.632905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.643775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714acdcb-5639-467c-9eee-9d303aa643af admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.649017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.649661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.649937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.650307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] PATH_INFO: `/v3/projects/ebffeb73a8874557bfb48a255100db7f/users/48ccd7d848084e11b9d7453acefe1416/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.666637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebffeb73a8874557bfb48a255100db7f, user_id=48ccd7d848084e11b9d7453acefe1416, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.669573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.683547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1060/2095] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:59 2022] PUT /identity/v3/projects/ebffeb73a8874557bfb48a255100db7f/users/48ccd7d848084e11b9d7453acefe1416/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:59.687822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.697785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4501ed-dc29-4381-b00c-23dc7d44aeca admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.732840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:59:59.756175 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f1b9a-d0df-4805-a992-d0ec96f888ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.756711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1b9a-d0df-4805-a992-d0ec96f888ff admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.756987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1b9a-d0df-4805-a992-d0ec96f888ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.757252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1b9a-d0df-4805-a992-d0ec96f888ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.757888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f1b9a-d0df-4805-a992-d0ec96f888ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.759509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f1b9a-d0df-4805-a992-d0ec96f888ff admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.769562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1036/2096] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 12:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:59:59.773960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.784665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3104e-8f02-4ef0-8582-9a552670ab3a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:59:59.789768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:59:59.790424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.790693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.790950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] PATH_INFO: `/v3/projects/ebffeb73a8874557bfb48a255100db7f/users/48ccd7d848084e11b9d7453acefe1416/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.793147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebffeb73a8874557bfb48a255100db7f, user_id=48ccd7d848084e11b9d7453acefe1416, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:59:59.795818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:59:59.806761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1061/2097] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 12:59:59 2022] PUT /identity/v3/projects/ebffeb73a8874557bfb48a255100db7f/users/48ccd7d848084e11b9d7453acefe1416/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:59:59.818303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c842-4937-4562-964e-4f89bee4a0fd None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:59:59.818711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c842-4937-4562-964e-4f89bee4a0fd None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:59:59.819163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0c842-4937-4562-964e-4f89bee4a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:59:59.856587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0ea0c842-4937-4562-964e-4f89bee4a0fd None None] MFA Rules not processed for user `48ccd7d848084e11b9d7453acefe1416`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:59:59.857802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0ea0c842-4937-4562-964e-4f89bee4a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:59:59.926636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1037/2098] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 12:59:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:59:59.938472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:59:59.940164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:00.002926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e33a5-068f-4600-b4f4-1c7e3e48fe31 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:00.006652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:00.007192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:00.007466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:00.007759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:00.017472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:00.019503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:00.030047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1062/2099] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 12:59:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:00.080547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c842-4937-4562-964e-4f89bee4a0fd None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:00.091499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0c842-4937-4562-964e-4f89bee4a0fd None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:00.095691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d74e3a-dacf-4af3-ad38-af452fcc3838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:00.096416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74e3a-dacf-4af3-ad38-af452fcc3838 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:00.096758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74e3a-dacf-4af3-ad38-af452fcc3838 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:00.097089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74e3a-dacf-4af3-ad38-af452fcc3838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:00.177229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d74e3a-dacf-4af3-ad38-af452fcc3838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:00.178768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d74e3a-dacf-4af3-ad38-af452fcc3838 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:00.188915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1038/2100] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:02.383895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:02.385716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:02.476143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafef222-67fd-4a42-bda9-b4ea9964e9c1 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:02.481709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:02.482536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:02.482871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:02.483250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] PATH_INFO: `/v3/users/492026473ae74e569734481980498501` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:02.485998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492026473ae74e569734481980498501)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:02.486454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:02.503292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:02.538065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492026473ae74e569734481980498501'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:02.548648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492026473ae74e569734481980498501'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:02.556333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492026473ae74e569734481980498501'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:02.556967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492026473ae74e569734481980498501'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:02.570393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492026473ae74e569734481980498501'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:02.576990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1063/2101] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:02 2022] DELETE /identity/v3/users/492026473ae74e569734481980498501 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:02.581644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:02.582105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:02.582194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:02.602193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:02.603559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:02.654890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:02.664961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1039/2102] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:02.675471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:02.677125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:02.738586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668df26-8236-4a88-a301-b2ae82767f95 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:02.742735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:02.743353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:02.743637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:02.743915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:02.753491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:02.754935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:02.765101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1064/2103] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:03.038284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:03.039811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:03.053468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b2b2-6a09-4a0a-8557-d0f37693eeee None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:03.058391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:03.059202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:03.059477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:03.059784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] PATH_INFO: `/v3/projects/7b9246751f9f4623a416f0fcb0540dbd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:03.061074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9246751f9f4623a416f0fcb0540dbd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:03.065264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:03.127294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9246751f9f4623a416f0fcb0540dbd', 'request_id': 'req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.151338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9246751f9f4623a416f0fcb0540dbd', 'request_id': 'req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.160554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9246751f9f4623a416f0fcb0540dbd', 'request_id': 'req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.174754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] The token cache is being invalidate because project 7b9246751f9f4623a416f0fcb0540dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:03.175041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.175805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.178261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1040/2104] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:03 2022] DELETE /identity/v3/projects/7b9246751f9f4623a416f0fcb0540dbd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:03.182124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:03.192283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97b25-9dce-4327-84ee-664db050b25c service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:03.271831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:03.272811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:03.272939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:03.273117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] PATH_INFO: `/v3/users/ca4090fbf6da4068831d284b3e832499` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:03.274347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4090fbf6da4068831d284b3e832499)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:03.276528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:03.349970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:03.363976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4090fbf6da4068831d284b3e832499'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.380283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4090fbf6da4068831d284b3e832499'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.394801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4090fbf6da4068831d284b3e832499'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.396344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4090fbf6da4068831d284b3e832499'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.415797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5bf36422-86d3-428f-a163-39e9fd954849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4090fbf6da4068831d284b3e832499'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.424338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1065/2105] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:03 2022] DELETE /identity/v3/users/ca4090fbf6da4068831d284b3e832499 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:03.652735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:03.655684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:03.680431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad286d1-48a9-4c3e-8961-ddf6f08ba8d4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:03.788643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:03.789413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:03.789752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:03.790082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] PATH_INFO: `/v3/users/42df069f3e6842208d1a07b9a2c1e05d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:03.791879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42df069f3e6842208d1a07b9a2c1e05d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:03.794048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:03.854887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42df069f3e6842208d1a07b9a2c1e05d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.866839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42df069f3e6842208d1a07b9a2c1e05d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.867848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42df069f3e6842208d1a07b9a2c1e05d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.868607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42df069f3e6842208d1a07b9a2c1e05d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.889587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42df069f3e6842208d1a07b9a2c1e05d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:03.906121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:03.913660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1041/2106] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:03 2022] DELETE /identity/v3/users/42df069f3e6842208d1a07b9a2c1e05d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:03.915659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:03.916165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:03.916521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:03.945583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:03.945856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:03.947417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:03.949820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.031742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1066/2107] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:04.041031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.042814 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.068795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478a406-8e67-4a16-8ebf-969b1931b302 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.073773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.074611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.074954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.075404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] PATH_INFO: `/v3/projects/98265a217bb84685855e5a76beb6876b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.076566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] RBAC: Authorizing `identity:delete_project(project_id=98265a217bb84685855e5a76beb6876b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.078503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.113722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181c20f-32eb-4730-baf4-13cd507a21f3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.118230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25a47f-8c81-44b7-a903-61bb5d35a173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.118847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a47f-8c81-44b7-a903-61bb5d35a173 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.119120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a47f-8c81-44b7-a903-61bb5d35a173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.119383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a47f-8c81-44b7-a903-61bb5d35a173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.128993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25a47f-8c81-44b7-a903-61bb5d35a173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.130430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25a47f-8c81-44b7-a903-61bb5d35a173 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.135040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98265a217bb84685855e5a76beb6876b', 'request_id': 'req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.140239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1067/2108] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:04.146358 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98265a217bb84685855e5a76beb6876b', 'request_id': 'req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.154381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98265a217bb84685855e5a76beb6876b', 'request_id': 'req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.166775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] The token cache is being invalidate because project 98265a217bb84685855e5a76beb6876b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:04.167496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.168259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3242f4a8-1a57-4feb-9982-5f6fbe15e22e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.170485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1042/2109] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:03 2022] DELETE /identity/v3/projects/98265a217bb84685855e5a76beb6876b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:04.177450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998b60-26f1-428e-a90d-aafe8fc2e910 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.177736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998b60-26f1-428e-a90d-aafe8fc2e910 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.178004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1998b60-26f1-428e-a90d-aafe8fc2e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.201344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b1998b60-26f1-428e-a90d-aafe8fc2e910 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:04.203049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b1998b60-26f1-428e-a90d-aafe8fc2e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.262073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:04.272951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1068/2110] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:04.281249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad03750-becb-4862-9539-2213d3f1e4a0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.281731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad03750-becb-4862-9539-2213d3f1e4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.282106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad03750-becb-4862-9539-2213d3f1e4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.303411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-aad03750-becb-4862-9539-2213d3f1e4a0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:04.309998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-aad03750-becb-4862-9539-2213d3f1e4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.323839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1043/2111] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:04.324881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1998b60-26f1-428e-a90d-aafe8fc2e910 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.334276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1998b60-26f1-428e-a90d-aafe8fc2e910 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.339336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.340128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.340415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.340703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.341354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:04.341655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.343287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.357058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1069/2112] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:00:04.361337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad03750-becb-4862-9539-2213d3f1e4a0 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.372381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad03750-becb-4862-9539-2213d3f1e4a0 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.377902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.378632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.379007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.379373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.380239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.383225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.423739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1044/2113] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:04 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:04.425244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.437601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066f3f-e35e-40a9-81f9-6c60ebe7a1a6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.469808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.471571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.554060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.554960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.555237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.555869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.556523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.560514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.584205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babade-8b80-4e9d-aa35-ab68aaac73b7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.586010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1070/2114] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:04 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:04.590769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.591518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.592269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.592468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.592911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] PATH_INFO: `/v3/projects/704e069e2c8d404da7d0de87e1c6f01a` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.594023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704e069e2c8d404da7d0de87e1c6f01a)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.596329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.602339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:04.607955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e02d4-46cf-40b9-862e-a10661b17327 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.614067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.614787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.615044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.615262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.615945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.617628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.631747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1071/2115] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:04.635044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.652295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ed27f-f9e5-45ba-b7fd-248928d4c30b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.666896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704e069e2c8d404da7d0de87e1c6f01a', 'request_id': 'req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.682193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704e069e2c8d404da7d0de87e1c6f01a', 'request_id': 'req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.694238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704e069e2c8d404da7d0de87e1c6f01a', 'request_id': 'req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.718778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] The token cache is being invalidate because project 704e069e2c8d404da7d0de87e1c6f01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:04.719075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.720133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:04.721625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1045/2116] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:04 2022] DELETE /identity/v3/projects/704e069e2c8d404da7d0de87e1c6f01a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:04.726832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.728925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.769131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.769792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.770640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.770640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.771103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.772766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.784701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1072/2117] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:04.789251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:04.793917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.808698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ac2ca-e2ab-455f-bc98-7945b8246852 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.814521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4051a0-17c0-4c34-a4b8-e16c991979b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.815719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4051a0-17c0-4c34-a4b8-e16c991979b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.816129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4051a0-17c0-4c34-a4b8-e16c991979b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.816537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4051a0-17c0-4c34-a4b8-e16c991979b3 admin admin] PATH_INFO: `/v3/projects/75d7ae6759ea4c84825392dadd98a403/users/d3fd88bb989745c3ba06db66df0108a1/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.841430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4051a0-17c0-4c34-a4b8-e16c991979b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d7ae6759ea4c84825392dadd98a403, user_id=d3fd88bb989745c3ba06db66df0108a1, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.844782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4051a0-17c0-4c34-a4b8-e16c991979b3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.872320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1073/2118] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:04 2022] PUT /identity/v3/projects/75d7ae6759ea4c84825392dadd98a403/users/d3fd88bb989745c3ba06db66df0108a1/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:04.872670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b7bb6-78fb-4454-9cdf-d640b0f0adc9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:04.876217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e76f-6fbd-44e5-83d8-78f3d45016ce None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.878455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e76f-6fbd-44e5-83d8-78f3d45016ce None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.878738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e76f-6fbd-44e5-83d8-78f3d45016ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.907393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-13b5e76f-6fbd-44e5-83d8-78f3d45016ce None None] MFA Rules not processed for user `adff6418c8d54bb9913a5d26b7fa09c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:04.908856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-13b5e76f-6fbd-44e5-83d8-78f3d45016ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:04.947075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:04.947571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:04.947876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:04.948198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] PATH_INFO: `/v3/users/1ddddbd0bf724b5f9311cfab70b4a66e` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:04.949645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddddbd0bf724b5f9311cfab70b4a66e)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:04.951543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:04.958950 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:05.003280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1074/2119] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:05.005352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:05.005769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:05.006203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:05.008076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:05.017324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddddbd0bf724b5f9311cfab70b4a66e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.034323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddddbd0bf724b5f9311cfab70b4a66e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.034495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddddbd0bf724b5f9311cfab70b4a66e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.035008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddddbd0bf724b5f9311cfab70b4a66e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.048208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddddbd0bf724b5f9311cfab70b4a66e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.049091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] MFA Rules not processed for user `d3fd88bb989745c3ba06db66df0108a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:05.050587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:05.089518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1046/2120] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:04 2022] DELETE /identity/v3/users/1ddddbd0bf724b5f9311cfab70b4a66e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:05.195976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1075/2121] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:05.230762 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:05.233197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:05.337705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e05d-851c-4add-ba0b-9725b1dd5d1a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:05.341630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd3e7d-7362-47bf-8315-1072367d8e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:05.342323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd3e7d-7362-47bf-8315-1072367d8e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:05.342730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd3e7d-7362-47bf-8315-1072367d8e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:05.343067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd3e7d-7362-47bf-8315-1072367d8e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:05.405662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd3e7d-7362-47bf-8315-1072367d8e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:05.407088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd3e7d-7362-47bf-8315-1072367d8e18 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:05.417292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1047/2122] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:05.445636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:05.447097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:05.461037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db397709-de88-4d3c-82fb-a6c104896e84 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:05.530144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:05.530741 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:05.531161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:05.531595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] PATH_INFO: `/v3/users/d3fd88bb989745c3ba06db66df0108a1` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:05.532840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fd88bb989745c3ba06db66df0108a1)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:05.535729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:05.596838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fd88bb989745c3ba06db66df0108a1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.607977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fd88bb989745c3ba06db66df0108a1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.616259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fd88bb989745c3ba06db66df0108a1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.616982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fd88bb989745c3ba06db66df0108a1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.628568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:05.635613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fd88bb989745c3ba06db66df0108a1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.653149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1076/2123] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:05 2022] DELETE /identity/v3/users/d3fd88bb989745c3ba06db66df0108a1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:05.654741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:05.655478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:05.655478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:05.679055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:05.680546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:05.733330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:05.734848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:05.782101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1048/2124] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:05.792076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:05.793733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:05.811643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:05.814544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a0c78-102c-4f26-a530-c603344bff40 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:05.820336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:05.821153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:05.821624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:05.821887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] PATH_INFO: `/v3/projects/eaa97d6f08be4e559f9687aeec3335bb` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:05.823770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa97d6f08be4e559f9687aeec3335bb)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:05.825849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:05.867174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51cb14-31bb-4ddd-b4a4-11bd2647ba54 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:05.872642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:05.873741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:05.874346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:05.874827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:05.888311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:05.888941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa97d6f08be4e559f9687aeec3335bb', 'request_id': 'req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.890722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:05.899964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa97d6f08be4e559f9687aeec3335bb', 'request_id': 'req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.906625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa97d6f08be4e559f9687aeec3335bb', 'request_id': 'req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.922380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1049/2125] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:05.924195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] The token cache is being invalidate because project eaa97d6f08be4e559f9687aeec3335bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:05.924460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.925168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:05.927391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1077/2126] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:05 2022] DELETE /identity/v3/projects/eaa97d6f08be4e559f9687aeec3335bb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:05.931104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:05.956423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5f8bd-5f6f-4868-a408-7f10fbf813f9 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:06.015754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:06.016408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:06.016992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:06.017345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] PATH_INFO: `/v3/users/48ccd7d848084e11b9d7453acefe1416` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:06.018600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ccd7d848084e11b9d7453acefe1416)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:06.020868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:06.075860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ccd7d848084e11b9d7453acefe1416'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.085979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ccd7d848084e11b9d7453acefe1416'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.086844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ccd7d848084e11b9d7453acefe1416'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.087449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ccd7d848084e11b9d7453acefe1416'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.106821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ccd7d848084e11b9d7453acefe1416'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.133645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1050/2127] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:05 2022] DELETE /identity/v3/users/48ccd7d848084e11b9d7453acefe1416 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:06.252909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:06.256130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:06.278010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbe53c-ca5e-4b9e-abe2-7e9b14e52d0c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:06.450623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:06.451371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:06.451621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:06.452779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] PATH_INFO: `/v3/projects/75d7ae6759ea4c84825392dadd98a403` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:06.454957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d7ae6759ea4c84825392dadd98a403)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:06.457127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:06.517530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:06.519086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:06.522370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:06.552469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4342f-cfab-470c-87b5-b71e7808e80c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:06.562021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d7ae6759ea4c84825392dadd98a403', 'request_id': 'req-f8e48b5b-f0be-4fde-a8fe-786c631e00da'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.575052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d7ae6759ea4c84825392dadd98a403', 'request_id': 'req-f8e48b5b-f0be-4fde-a8fe-786c631e00da'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.584779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d7ae6759ea4c84825392dadd98a403', 'request_id': 'req-f8e48b5b-f0be-4fde-a8fe-786c631e00da'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.599043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] The token cache is being invalidate because project 75d7ae6759ea4c84825392dadd98a403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:06.599375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.600046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f8e48b5b-f0be-4fde-a8fe-786c631e00da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.601772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1078/2128] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:06 2022] DELETE /identity/v3/projects/75d7ae6759ea4c84825392dadd98a403 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:06.614275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:06.682437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:06.684498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:06.684981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:06.685282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] PATH_INFO: `/v3/projects/ebffeb73a8874557bfb48a255100db7f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:06.687226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebffeb73a8874557bfb48a255100db7f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:06.689533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:06.762855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebffeb73a8874557bfb48a255100db7f', 'request_id': 'req-fa7ec73a-8691-481a-aff4-faa8d0640b79'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.773171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebffeb73a8874557bfb48a255100db7f', 'request_id': 'req-fa7ec73a-8691-481a-aff4-faa8d0640b79'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.781681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebffeb73a8874557bfb48a255100db7f', 'request_id': 'req-fa7ec73a-8691-481a-aff4-faa8d0640b79'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.797666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] The token cache is being invalidate because project ebffeb73a8874557bfb48a255100db7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:06.798208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.798941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fa7ec73a-8691-481a-aff4-faa8d0640b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:06.801938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1051/2129] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:06 2022] DELETE /identity/v3/projects/ebffeb73a8874557bfb48a255100db7f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:06.808841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6351d25-b1c0-45fb-873c-12deae90ac5b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:06.809262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6351d25-b1c0-45fb-873c-12deae90ac5b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:06.809824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6351d25-b1c0-45fb-873c-12deae90ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:06.837560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b6351d25-b1c0-45fb-873c-12deae90ac5b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:06.839100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b6351d25-b1c0-45fb-873c-12deae90ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:06.917646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1079/2130] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:06.926328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8dbd-887e-41aa-add4-120e7c04783c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:06.927270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8dbd-887e-41aa-add4-120e7c04783c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:06.927270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8dbd-887e-41aa-add4-120e7c04783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:06.948019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-067d8dbd-887e-41aa-add4-120e7c04783c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:06.949324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-067d8dbd-887e-41aa-add4-120e7c04783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:06.969876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1052/2131] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:06.977341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6351d25-b1c0-45fb-873c-12deae90ac5b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:06.992160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6351d25-b1c0-45fb-873c-12deae90ac5b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:06.997795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:06.998638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:06.998936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:06.999190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:06.999875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:07.000264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.001916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.015763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1080/2132] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:07.019936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8dbd-887e-41aa-add4-120e7c04783c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.031235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8dbd-887e-41aa-add4-120e7c04783c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.036008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.036622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.036896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.037162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.037792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.039737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.073602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1053/2133] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:07 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:07.078242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.088664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621cf7c-1a5f-4ae6-b080-b58ef75e4db6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.153101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.153745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.153995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.154295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.155154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.157223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.182113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1081/2134] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:07 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:07.186370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.196649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb0ade-d23a-46a4-bfc5-0d242f44e204 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.201345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.201966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.202226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.202496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.203138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.204791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.214794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1054/2135] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:07.218762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.229397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7209f-f230-40d0-aed3-229dd87bebbe admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.236162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ae2dd-9286-469f-87e4-8a070aca5a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.236867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ae2dd-9286-469f-87e4-8a070aca5a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.237187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ae2dd-9286-469f-87e4-8a070aca5a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.237460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ae2dd-9286-469f-87e4-8a070aca5a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.238321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ae2dd-9286-469f-87e4-8a070aca5a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.239992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ae2dd-9286-469f-87e4-8a070aca5a35 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.251481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1082/2136] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:07.257933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.268810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301cd05-f127-4aab-b297-5e9150cce974 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.274402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.275065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.275339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.275604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] PATH_INFO: `/v3/projects/92869475c2af4cffb9f66b17cfc29175/users/c4d3860451aa44f18cb3ed86cb4cf341/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.293736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92869475c2af4cffb9f66b17cfc29175, user_id=c4d3860451aa44f18cb3ed86cb4cf341, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.296459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.315646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1055/2137] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:07 2022] PUT /identity/v3/projects/92869475c2af4cffb9f66b17cfc29175/users/c4d3860451aa44f18cb3ed86cb4cf341/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:07.331985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.332292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.332568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.361252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] MFA Rules not processed for user `c4d3860451aa44f18cb3ed86cb4cf341`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:07.362473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:07.367536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:07.435028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1083/2138] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:07.439735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.508217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4180e3-72db-45ae-9e95-6ccf4c96bd61 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.513991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.515500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.515500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.515500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.515945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.517840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.523731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:07.531132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.533175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:07.550472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429d51e-a84e-4288-b060-4411462aa9e7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.556146 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.556911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.557291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.557851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] PATH_INFO: `/v3/users/299a4768e9014d93a6031e8b532c9b9b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.559732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1056/2139] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:07 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:07.562583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.563201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=299a4768e9014d93a6031e8b532c9b9b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.565370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.631503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299a4768e9014d93a6031e8b532c9b9b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:07.646979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299a4768e9014d93a6031e8b532c9b9b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:07.647783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895d73-7517-437e-ab1d-9516a219f335 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.654126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.655318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.655435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299a4768e9014d93a6031e8b532c9b9b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:07.655978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.656814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.657283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.659401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.668300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299a4768e9014d93a6031e8b532c9b9b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:07.686811 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1057/2140] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:07 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:07.689769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.691493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:07.698867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-f13e9b58-6c45-4ad3-a697-c74e7cc4b08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299a4768e9014d93a6031e8b532c9b9b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:07.713840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9715e5-674f-475e-b10c-de508ecabc46 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.719911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1084/2141] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:07 2022] DELETE /identity/v3/users/299a4768e9014d93a6031e8b532c9b9b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:07.726369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.726795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.727067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.749940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:07.751225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:07.819279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.820553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.820866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.821384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.821980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.824043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.838069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1085/2142] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:07.843622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1058/2143] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:07.850281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.850792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.853201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:07.864313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ba56-6565-45bb-b12e-c4d37cb3e7c1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.870288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:07.871089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:07.871982 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:07.872257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] PATH_INFO: `/v3/projects/12eec36ab9ef47c2937642062ec8c918/users/9da766d960a04d2fb72020b9733b50ac/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:07.889771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:07.901718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12eec36ab9ef47c2937642062ec8c918, user_id=9da766d960a04d2fb72020b9733b50ac, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:07.905112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:07.922812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1059/2144] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:07 2022] PUT /identity/v3/projects/12eec36ab9ef47c2937642062ec8c918/users/9da766d960a04d2fb72020b9733b50ac/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:07.927437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:07.942380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa824a-63ed-4e2e-aca1-50ccf33ebb7d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:07.989768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:08.011352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4acc4e-5852-4d64-8ec4-b418f587d528 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:08.015894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:08.018245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:08.018660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:08.019611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:08.029598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8f6e-feab-46b2-bf8d-ae2f3696a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:08.030767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8f6e-feab-46b2-bf8d-ae2f3696a235 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:08.031392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8f6e-feab-46b2-bf8d-ae2f3696a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:08.031939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8f6e-feab-46b2-bf8d-ae2f3696a235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:08.032335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:08.033104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c8f6e-feab-46b2-bf8d-ae2f3696a235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:08.034121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:08.035405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c8f6e-feab-46b2-bf8d-ae2f3696a235 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:08.048192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1086/2145] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:08.055353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1060/2146] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:08.056338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:08.068695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd7323-f0ea-4e32-addc-2b5b907e1613 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:08.077641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:08.079336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:08.079730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:08.080081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] PATH_INFO: `/v3/projects/12eec36ab9ef47c2937642062ec8c918/users/9da766d960a04d2fb72020b9733b50ac/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:08.082295 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12eec36ab9ef47c2937642062ec8c918, user_id=9da766d960a04d2fb72020b9733b50ac, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:08.085550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:08.099023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1087/2147] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:08 2022] PUT /identity/v3/projects/12eec36ab9ef47c2937642062ec8c918/users/9da766d960a04d2fb72020b9733b50ac/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:08.110276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:08.110563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:08.110839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:08.156403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] MFA Rules not processed for user `9da766d960a04d2fb72020b9733b50ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:08.157554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:08.255773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1061/2148] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:08.268327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:08.270445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:08.343292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882811e9-0fac-4fe5-8aaf-71c4b57c4c90 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:08.349561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:08.350262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:08.350542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:08.350838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:08.357891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:08.459548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:08.461203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:08.472583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1088/2149] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:08.626142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:08.628048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:08.707475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9598-5fd4-44d8-af1b-2210cfb34445 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:08.712135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:08.712773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:08.713051 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:08.713354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] PATH_INFO: `/v3/projects/b7ab5cf04dd941ff9453137b8bdab0f3` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:08.714426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ab5cf04dd941ff9453137b8bdab0f3)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:08.716393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:08.771394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ab5cf04dd941ff9453137b8bdab0f3', 'request_id': 'req-fb283942-eea2-4084-ab73-098e00001eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:08.799848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ab5cf04dd941ff9453137b8bdab0f3', 'request_id': 'req-fb283942-eea2-4084-ab73-098e00001eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:08.809433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ab5cf04dd941ff9453137b8bdab0f3', 'request_id': 'req-fb283942-eea2-4084-ab73-098e00001eb4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:08.817863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:08.825655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] The token cache is being invalidate because project b7ab5cf04dd941ff9453137b8bdab0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:08.826192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:08.827974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:08.830496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1062/2150] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:08 2022] DELETE /identity/v3/projects/b7ab5cf04dd941ff9453137b8bdab0f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:08.834644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:08.852934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a87806-24e6-4a99-919c-90292a5bce81 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:08.881021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:08.938369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:08.939056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:08.939405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:08.939776 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] PATH_INFO: `/v3/users/6dea204d660a4ac2bb8c8b8c0533fcf4` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:08.941633 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dea204d660a4ac2bb8c8b8c0533fcf4)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:08.943641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:09.003779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dea204d660a4ac2bb8c8b8c0533fcf4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.016313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dea204d660a4ac2bb8c8b8c0533fcf4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.028225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dea204d660a4ac2bb8c8b8c0533fcf4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.029654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dea204d660a4ac2bb8c8b8c0533fcf4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.050690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5cc8662d-6004-4229-aba7-5ca31cfbc2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dea204d660a4ac2bb8c8b8c0533fcf4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.059423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1089/2151] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:08 2022] DELETE /identity/v3/users/6dea204d660a4ac2bb8c8b8c0533fcf4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:09.665271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:09.667135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:09.686954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283942-eea2-4084-ab73-098e00001eb4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:09.745303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:09.746299 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:09.746574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:09.746839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] PATH_INFO: `/v3/projects/c10802e22dc843e9b358b64bd5b7ca9b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:09.748058 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10802e22dc843e9b358b64bd5b7ca9b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:09.750011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:09.802629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10802e22dc843e9b358b64bd5b7ca9b', 'request_id': 'req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.811721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10802e22dc843e9b358b64bd5b7ca9b', 'request_id': 'req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.817757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10802e22dc843e9b358b64bd5b7ca9b', 'request_id': 'req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.829873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] The token cache is being invalidate because project c10802e22dc843e9b358b64bd5b7ca9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:09.830177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.830863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-13aef5aa-8dc8-46ef-880f-ac3a6d2bf9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:09.832586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1063/2152] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:09 2022] DELETE /identity/v3/projects/c10802e22dc843e9b358b64bd5b7ca9b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:09.838066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369fa5c-a773-4990-8038-326abffe81cf None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:09.838533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369fa5c-a773-4990-8038-326abffe81cf None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:09.838708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369fa5c-a773-4990-8038-326abffe81cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:09.859644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7369fa5c-a773-4990-8038-326abffe81cf None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:09.860879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7369fa5c-a773-4990-8038-326abffe81cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:09.922219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1090/2153] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:09.929553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfc6ff-2225-4b7c-89de-6f2b2c4304b8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:09.929900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfc6ff-2225-4b7c-89de-6f2b2c4304b8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:09.930230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfc6ff-2225-4b7c-89de-6f2b2c4304b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:09.952043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2dcfc6ff-2225-4b7c-89de-6f2b2c4304b8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:09.953252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2dcfc6ff-2225-4b7c-89de-6f2b2c4304b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:09.962349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1064/2154] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:09.967028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369fa5c-a773-4990-8038-326abffe81cf None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:09.978001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369fa5c-a773-4990-8038-326abffe81cf None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:09.983083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:09.983531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:09.983850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:09.984104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:09.984755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:09.985055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:09.986663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.001994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1091/2155] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:10.003211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfc6ff-2225-4b7c-89de-6f2b2c4304b8 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.012920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfc6ff-2225-4b7c-89de-6f2b2c4304b8 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.018463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.019378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.019664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.019961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.020593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.022480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.053443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1065/2156] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:10 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:10.057992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.070052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca221d9-d6e9-425e-aa63-04db1beb258f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.101736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:10.138105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.138726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.139002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.139269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.139969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.142064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.165684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1092/2157] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:10 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:10.170141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.183788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a5c7d-96a7-4eaa-96c8-d7fd16950a7e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.189367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.190002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.190287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.190523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.191415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.193302 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.211365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1066/2158] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:10.212990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.224392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b7559-be64-46e8-afbb-784891e95707 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.229120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee66978-3f87-4e27-b126-dc11206f2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.229815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66978-3f87-4e27-b126-dc11206f2190 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.230250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66978-3f87-4e27-b126-dc11206f2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.230572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66978-3f87-4e27-b126-dc11206f2190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.231298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66978-3f87-4e27-b126-dc11206f2190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.233275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66978-3f87-4e27-b126-dc11206f2190 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.245063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1093/2159] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:10.249834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.260593 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c38581-37f4-411d-ab2f-a797fd2253ef admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.266348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.267013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.267289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.267556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] PATH_INFO: `/v3/projects/8301d3bed9d14783a3151fc54786ca3b/users/302514ab1ba242fb8b1eab0030546326/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.282738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8301d3bed9d14783a3151fc54786ca3b, user_id=302514ab1ba242fb8b1eab0030546326, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.285463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.301033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1067/2160] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:10 2022] PUT /identity/v3/projects/8301d3bed9d14783a3151fc54786ca3b/users/302514ab1ba242fb8b1eab0030546326/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:10.313049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05bcf-1cde-44ac-b6b0-8024f67923cd None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.313330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05bcf-1cde-44ac-b6b0-8024f67923cd None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.313605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05bcf-1cde-44ac-b6b0-8024f67923cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.342884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-fbd05bcf-1cde-44ac-b6b0-8024f67923cd None None] MFA Rules not processed for user `302514ab1ba242fb8b1eab0030546326`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:10.344473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fbd05bcf-1cde-44ac-b6b0-8024f67923cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:10.425155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1094/2161] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:10.430026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.462460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:10.496813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb24b-b589-4fb1-87c7-65b49047409b admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.501909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.502522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.502800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.503071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.503721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.505652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.533949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1068/2162] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:10 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:10.538443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05bcf-1cde-44ac-b6b0-8024f67923cd None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.549386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05bcf-1cde-44ac-b6b0-8024f67923cd None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.610706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.611355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.611687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.612002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.612635 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.614580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.636965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1095/2163] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:10 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:10.641061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.651815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e083de-813a-4299-9439-511ebc4df039 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.657055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.657705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.659912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.659912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.659912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.660569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.673249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1069/2164] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:10.677467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.689307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e529e1-8121-4ef9-8e22-32e1e47c4145 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.695840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.696524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.696941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.697213 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] PATH_INFO: `/v3/projects/0fe4d80dfcd04a26bc8a8eeeb9b32fc3/users/788a7d2a374d47e4b9f7f6aea86b307a/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.713826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe4d80dfcd04a26bc8a8eeeb9b32fc3, user_id=788a7d2a374d47e4b9f7f6aea86b307a, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.716520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.730200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:10.736373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1096/2165] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:10 2022] PUT /identity/v3/projects/0fe4d80dfcd04a26bc8a8eeeb9b32fc3/users/788a7d2a374d47e4b9f7f6aea86b307a/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:10.740287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.750794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963270-ce84-4309-b36c-aef061a9feff admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.815096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876a66-8ecf-421f-beaa-6867d7b8480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.815738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876a66-8ecf-421f-beaa-6867d7b8480a admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.816019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876a66-8ecf-421f-beaa-6867d7b8480a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.816281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876a66-8ecf-421f-beaa-6867d7b8480a admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.816910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876a66-8ecf-421f-beaa-6867d7b8480a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.818505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876a66-8ecf-421f-beaa-6867d7b8480a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.828955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1070/2166] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:10.833200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:10.843618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0573-7151-4178-8774-48a57549f676 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:10.848769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:10.849430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.849705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.849971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] PATH_INFO: `/v3/projects/0fe4d80dfcd04a26bc8a8eeeb9b32fc3/users/788a7d2a374d47e4b9f7f6aea86b307a/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.851903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe4d80dfcd04a26bc8a8eeeb9b32fc3, user_id=788a7d2a374d47e4b9f7f6aea86b307a, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:10.854529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:10.864779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1097/2167] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:10 2022] PUT /identity/v3/projects/0fe4d80dfcd04a26bc8a8eeeb9b32fc3/users/788a7d2a374d47e4b9f7f6aea86b307a/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:10.875343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:10.875623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:10.875934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:10.903291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] MFA Rules not processed for user `788a7d2a374d47e4b9f7f6aea86b307a`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:10.904519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:10.988382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1071/2168] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:10.996036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:11.006912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:11.069621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1ce94-8fc1-41af-9147-7f71793076e7 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:11.073387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:11.074080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:11.074424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:11.074848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:11.120440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:11.122507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:11.143175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:11.144924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:11.151188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:11.156257 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1098/2169] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:11.198325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb8d58-fc32-4851-8d63-06001893508a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:11.204964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:11.205266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:11.205266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:11.205530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] PATH_INFO: `/v3/users/c4d3860451aa44f18cb3ed86cb4cf341` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:11.206814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d3860451aa44f18cb3ed86cb4cf341)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:11.208774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:11.246194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:11.248375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:11.264849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c71ad0-0b1a-4a9f-a6f2-722fb9c539b4 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:11.269027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d3860451aa44f18cb3ed86cb4cf341'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.269849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:11.270511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:11.270779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:11.271044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] PATH_INFO: `/v3/users/a1f862fd25674b099977258abdc6e3d4` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:11.272188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f862fd25674b099977258abdc6e3d4)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:11.274270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:11.281128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d3860451aa44f18cb3ed86cb4cf341'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.281764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d3860451aa44f18cb3ed86cb4cf341'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.282415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d3860451aa44f18cb3ed86cb4cf341'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.289810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aca80a8d-ab40-4936-8574-3e34e1a8938b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d3860451aa44f18cb3ed86cb4cf341'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.308791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1072/2170] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:11 2022] DELETE /identity/v3/users/c4d3860451aa44f18cb3ed86cb4cf341 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:11.313636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:11.313976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:11.314202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:11.339360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f862fd25674b099977258abdc6e3d4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.339804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:11.341884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:11.349877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f862fd25674b099977258abdc6e3d4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.359404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f862fd25674b099977258abdc6e3d4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.360191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f862fd25674b099977258abdc6e3d4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.373129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-394bf328-abf2-4e43-be86-234d1a4575ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f862fd25674b099977258abdc6e3d4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:11.379797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1099/2171] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:11 2022] DELETE /identity/v3/users/a1f862fd25674b099977258abdc6e3d4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:11.384393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:11.384393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:11.384636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:11.405348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:11.406594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:11.416164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:11.423915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1073/2172] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:11.433813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:11.435445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:11.495325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:11.495755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1100/2173] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:11.507282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:11.508941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:11.522116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3f27-acf4-4204-a4b0-7755096d3ab8 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:11.583294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:11.583946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:11.584334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:11.584569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:11.589864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef611c-3450-441a-8e0b-0c546e62f86a None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:11.594607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:11.595011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:11.595222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:11.595492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:11.595774 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:11.596539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:11.605431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:11.606799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1074/2174] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:11.607100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:11.618374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1101/2175] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:12.180024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.181573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.195646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d22399-fdfd-45bb-95fd-ae3375706d05 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.207229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.210839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.211672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.211996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.212417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.212827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] PATH_INFO: `/v3/projects/92869475c2af4cffb9f66b17cfc29175` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.214608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92869475c2af4cffb9f66b17cfc29175)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.217160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.242180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b199fb-2126-4ac8-9011-b4dd5ea3f0af service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.258640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.259963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.260406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.260764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] PATH_INFO: `/v3/projects/419f0b4d22134a20809fc1a4ffdf99c0` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.262437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=419f0b4d22134a20809fc1a4ffdf99c0)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.268570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.292641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92869475c2af4cffb9f66b17cfc29175', 'request_id': 'req-b771e366-4ebb-41b1-98f9-186a82c33fd4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.304212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92869475c2af4cffb9f66b17cfc29175', 'request_id': 'req-b771e366-4ebb-41b1-98f9-186a82c33fd4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.319075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92869475c2af4cffb9f66b17cfc29175', 'request_id': 'req-b771e366-4ebb-41b1-98f9-186a82c33fd4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.328867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] The token cache is being invalidate because project 92869475c2af4cffb9f66b17cfc29175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:12.329115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.329613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.331435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1075/2176] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:12 2022] DELETE /identity/v3/projects/92869475c2af4cffb9f66b17cfc29175 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:12.335180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.336772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.346569 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419f0b4d22134a20809fc1a4ffdf99c0', 'request_id': 'req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.358359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419f0b4d22134a20809fc1a4ffdf99c0', 'request_id': 'req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.367869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419f0b4d22134a20809fc1a4ffdf99c0', 'request_id': 'req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.381832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] The token cache is being invalidate because project 419f0b4d22134a20809fc1a4ffdf99c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:12.382136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.383101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9ca6a644-0198-4e41-a0d8-20c57cbf54a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.389305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1102/2177] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:12 2022] DELETE /identity/v3/projects/419f0b4d22134a20809fc1a4ffdf99c0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:12.390534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef7242-5298-4dbe-a0c8-7d0cbe790121 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.390815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef7242-5298-4dbe-a0c8-7d0cbe790121 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.391081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef7242-5298-4dbe-a0c8-7d0cbe790121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.410283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771e366-4ebb-41b1-98f9-186a82c33fd4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.412350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-beef7242-5298-4dbe-a0c8-7d0cbe790121 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:12.413659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-beef7242-5298-4dbe-a0c8-7d0cbe790121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.443934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:12.452707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:12.482836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.483602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.483967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.484304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] PATH_INFO: `/v3/users/9da766d960a04d2fb72020b9733b50ac` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.485022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1103/2178] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:12.485743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da766d960a04d2fb72020b9733b50ac)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.487991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.493529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55bc9-6de6-4c66-9fe4-7bd57b20dd3f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.493898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55bc9-6de6-4c66-9fe4-7bd57b20dd3f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.494074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55bc9-6de6-4c66-9fe4-7bd57b20dd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.516421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e3b55bc9-6de6-4c66-9fe4-7bd57b20dd3f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:12.517668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e3b55bc9-6de6-4c66-9fe4-7bd57b20dd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.528960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1104/2179] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:12.531745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b55bc9-6de6-4c66-9fe4-7bd57b20dd3f None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.542460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b55bc9-6de6-4c66-9fe4-7bd57b20dd3f None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.547905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.548856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.549200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.549528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.550243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:12.550346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da766d960a04d2fb72020b9733b50ac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.550654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.552507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.560177 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da766d960a04d2fb72020b9733b50ac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.560768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da766d960a04d2fb72020b9733b50ac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.561404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da766d960a04d2fb72020b9733b50ac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.572756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da766d960a04d2fb72020b9733b50ac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:12.581572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1105/2180] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:00:12.585740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.588835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.611976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99daf-d828-4c67-9b9c-965718dcd436 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.612203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1076/2181] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:12 2022] DELETE /identity/v3/users/9da766d960a04d2fb72020b9733b50ac => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:12.630145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.632253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.682010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.683031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.683387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.683742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.684676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.688138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.715342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc1e9-cf2e-44ad-9d9c-54f35cd2b6cc admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.719682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.720405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.720676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.720960 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.722993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.739195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1106/2182] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:12 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:12.744279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.808769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.811111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.816872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:12.822173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1077/2183] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:12.829703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2ec0b-f122-48ad-a837-0386499fb9b6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.834553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.835272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.835549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.835843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.836503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.838429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.865007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1107/2184] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:12 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:12.868753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.879536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caea712-3e94-42dd-8b07-777c8239d46a service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.886482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.887333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.887672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.888105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.888919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.890573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.904980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1078/2185] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:12.906222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.918090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccd8b8-884c-4361-b589-ce792b86f855 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.924523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.925136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.925412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.925687 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.926339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.928140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.943739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1108/2186] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:12.944857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.951599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:12.953585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:12.955956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785cc1e-3bfd-4c35-9ec0-ecd84efa1b65 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.960674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c407-cf9b-4566-a41d-577d5f80d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.961349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c407-cf9b-4566-a41d-577d5f80d4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.961627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c407-cf9b-4566-a41d-577d5f80d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.961901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c407-cf9b-4566-a41d-577d5f80d4f5 admin admin] PATH_INFO: `/v3/projects/5b3dc01456f94c738fcd35c5f5aff786/users/fa9bd7fb2c2642cdbb1ec24fc9821346/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.972547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b975053-9703-4f82-880b-16dee068002b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:12.978128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:12.979667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:12.979980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:12.980254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] PATH_INFO: `/v3/projects/12eec36ab9ef47c2937642062ec8c918` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:12.981604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=12eec36ab9ef47c2937642062ec8c918)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.982165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c407-cf9b-4566-a41d-577d5f80d4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3dc01456f94c738fcd35c5f5aff786, user_id=fa9bd7fb2c2642cdbb1ec24fc9821346, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:12.984124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:12.984876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c407-cf9b-4566-a41d-577d5f80d4f5 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.010957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:13.021237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1079/2187] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:12 2022] PUT /identity/v3/projects/5b3dc01456f94c738fcd35c5f5aff786/users/fa9bd7fb2c2642cdbb1ec24fc9821346/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:13.031910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.032194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.032516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.047736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12eec36ab9ef47c2937642062ec8c918', 'request_id': 'req-97ac8000-653a-4710-8f95-fabda4bf68bb'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:13.065475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] MFA Rules not processed for user `fa9bd7fb2c2642cdbb1ec24fc9821346`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:13.066743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:13.068328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12eec36ab9ef47c2937642062ec8c918', 'request_id': 'req-97ac8000-653a-4710-8f95-fabda4bf68bb'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:13.075815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12eec36ab9ef47c2937642062ec8c918', 'request_id': 'req-97ac8000-653a-4710-8f95-fabda4bf68bb'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:13.094534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] The token cache is being invalidate because project 12eec36ab9ef47c2937642062ec8c918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:13.094847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:13.095470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97ac8000-653a-4710-8f95-fabda4bf68bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:13.097203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1109/2188] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:12 2022] DELETE /identity/v3/projects/12eec36ab9ef47c2937642062ec8c918 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:13.101683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf688-6b21-4b93-9eb5-50c056fa6f0a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.101961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf688-6b21-4b93-9eb5-50c056fa6f0a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.102238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cf688-6b21-4b93-9eb5-50c056fa6f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.125765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-943cf688-6b21-4b93-9eb5-50c056fa6f0a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:13.127734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-943cf688-6b21-4b93-9eb5-50c056fa6f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:13.146779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1080/2189] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:13.158435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.159891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:13.226048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4db67-2bc4-4a9a-8402-f8c8917f3bd0 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.230054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.230741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.231141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.231482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.241434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.243102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1110/2190] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:13.243606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.252223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa196fe-9a80-4aa4-8e75-34618f45ac81 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.252667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa196fe-9a80-4aa4-8e75-34618f45ac81 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.253004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa196fe-9a80-4aa4-8e75-34618f45ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.253614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1081/2191] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:13.292535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-faa196fe-9a80-4aa4-8e75-34618f45ac81 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:13.293962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-faa196fe-9a80-4aa4-8e75-34618f45ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:13.303977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1111/2192] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:13.308474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.323615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a18eb-2493-4916-a3ed-e04145c25a83 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.329553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.330169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.330555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.330827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.331475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:13.331797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.333623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.353364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa196fe-9a80-4aa4-8e75-34618f45ac81 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.361239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1082/2193] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:13.365599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa196fe-9a80-4aa4-8e75-34618f45ac81 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.371600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.372369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.372707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.373353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.373903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.376641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.410781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1112/2194] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:13 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:13.414267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.425990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9275038-c748-41e8-8162-bd6686ed8ef6 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.489935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:13.508332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.508855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.509352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.509491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.510223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.512509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.536276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1083/2195] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:13 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:13.541097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.552135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de610f-9daa-4f1b-87dd-62d89c27b189 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.557233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.558041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.558596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.558871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.559742 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.561445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.573836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1113/2196] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:13.576644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.589490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b45350-1167-4005-b8b7-8f215dd14634 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.594869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ff1e4-21a8-47d1-8909-6a4315cec494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.595493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff1e4-21a8-47d1-8909-6a4315cec494 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.595806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff1e4-21a8-47d1-8909-6a4315cec494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.596078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ff1e4-21a8-47d1-8909-6a4315cec494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.596720 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ff1e4-21a8-47d1-8909-6a4315cec494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.598426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ff1e4-21a8-47d1-8909-6a4315cec494 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.611963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1084/2197] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:13.616168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.632683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c605c-faef-4bd1-bc01-54f3f0c28fe3 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.632683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.632683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.632683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.633269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] PATH_INFO: `/v3/projects/9270ceb33dd048b480138bca84cf31e6/users/887067502abe4ada8ba7053acd576f15/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.650495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9270ceb33dd048b480138bca84cf31e6, user_id=887067502abe4ada8ba7053acd576f15, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.653305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.669442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1114/2198] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:13 2022] PUT /identity/v3/projects/9270ceb33dd048b480138bca84cf31e6/users/887067502abe4ada8ba7053acd576f15/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:13.674534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b452-64ff-45cc-bec3-1da384585fb2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.674805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b452-64ff-45cc-bec3-1da384585fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.675072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b452-64ff-45cc-bec3-1da384585fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.694323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8be4b452-64ff-45cc-bec3-1da384585fb2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:13.695543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8be4b452-64ff-45cc-bec3-1da384585fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:13.756638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1085/2199] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:13.768470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:13.770731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:13.820656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:13.834270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7b6af-adff-4360-a09f-8ea8bd7a8725 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:13.838293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:13.838904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:13.839180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:13.839450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:13.851339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:13.852968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:13.862979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1115/2200] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:14.790019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86b97f-e970-41fa-993b-6e61692fead6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:14.790511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86b97f-e970-41fa-993b-6e61692fead6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:14.790637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86b97f-e970-41fa-993b-6e61692fead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:14.829980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ec86b97f-e970-41fa-993b-6e61692fead6 None None] MFA Rules not processed for user `887067502abe4ada8ba7053acd576f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:14.829980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ec86b97f-e970-41fa-993b-6e61692fead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:14.921698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1086/2201] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:14.936117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:14.937925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:15.026792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8762-e057-4798-9128-f514c0a94c9b service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:15.031307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302964e-f242-499d-b878-6edab058964c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:15.031975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302964e-f242-499d-b878-6edab058964c service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:15.032336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302964e-f242-499d-b878-6edab058964c service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:15.032606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302964e-f242-499d-b878-6edab058964c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:15.046595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302964e-f242-499d-b878-6edab058964c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:15.048568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302964e-f242-499d-b878-6edab058964c service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:15.060100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1116/2202] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:16.499872 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd806e-27e1-434b-bc28-85c47a176691 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:16.500396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd806e-27e1-434b-bc28-85c47a176691 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:16.500396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd806e-27e1-434b-bc28-85c47a176691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:16.520821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c6fd806e-27e1-434b-bc28-85c47a176691 None None] MFA Rules not processed for user `887067502abe4ada8ba7053acd576f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:16.522160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c6fd806e-27e1-434b-bc28-85c47a176691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:16.529862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1087/2203] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:16.880099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302964e-f242-499d-b878-6edab058964c service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:16.881669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d302964e-f242-499d-b878-6edab058964c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:16.895150 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302964e-f242-499d-b878-6edab058964c service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:16.899495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:16.900152 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:16.900423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:16.900686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] PATH_INFO: `/v3/users/302514ab1ba242fb8b1eab0030546326` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:16.901772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=302514ab1ba242fb8b1eab0030546326)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:16.903746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:16.954371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302514ab1ba242fb8b1eab0030546326'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:16.962931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302514ab1ba242fb8b1eab0030546326'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:16.970544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302514ab1ba242fb8b1eab0030546326'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:16.971247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302514ab1ba242fb8b1eab0030546326'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:16.983578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302514ab1ba242fb8b1eab0030546326'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:16.989588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1117/2204] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:16 2022] DELETE /identity/v3/users/302514ab1ba242fb8b1eab0030546326 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:16.994139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:16.994439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:16.994732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:17.015230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:17.016685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:17.061028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:17.085296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1088/2205] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:17.095655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:17.097360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:17.174865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c938a-6368-4fc9-9a36-65330c55f00e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:17.174865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:17.174865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:17.174865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:17.175259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:17.184122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:17.185607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:17.195684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1118/2206] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:17.528924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:17.530553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:17.551679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dbb8e-4ea7-4233-800f-194791e33afc None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:17.566423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:17.567278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:17.567919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:17.568528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] PATH_INFO: `/v3/projects/8301d3bed9d14783a3151fc54786ca3b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:17.570343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8301d3bed9d14783a3151fc54786ca3b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:17.572719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:17.633543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8301d3bed9d14783a3151fc54786ca3b', 'request_id': 'req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.644650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8301d3bed9d14783a3151fc54786ca3b', 'request_id': 'req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.656329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8301d3bed9d14783a3151fc54786ca3b', 'request_id': 'req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.676557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] The token cache is being invalidate because project 8301d3bed9d14783a3151fc54786ca3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:17.676557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.676557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.685710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1089/2207] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:17 2022] DELETE /identity/v3/projects/8301d3bed9d14783a3151fc54786ca3b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:17.690147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:17.701420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:17.706852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88378c-bce2-45fb-b58a-82a80e23817f service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:17.799533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:17.799948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:17.800443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:17.800847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] PATH_INFO: `/v3/users/788a7d2a374d47e4b9f7f6aea86b307a` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:17.802091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] RBAC: Authorizing `identity:delete_user(user_id=788a7d2a374d47e4b9f7f6aea86b307a)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:17.804229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:17.880231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788a7d2a374d47e4b9f7f6aea86b307a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.893589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788a7d2a374d47e4b9f7f6aea86b307a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.904482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788a7d2a374d47e4b9f7f6aea86b307a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.905410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788a7d2a374d47e4b9f7f6aea86b307a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.938615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ed362c54-a9e2-4a8d-ab80-28500b59592c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788a7d2a374d47e4b9f7f6aea86b307a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:17.961032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1119/2208] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:17 2022] DELETE /identity/v3/users/788a7d2a374d47e4b9f7f6aea86b307a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:18.324833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:18.326374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:18.340490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef499ea-8f2a-4bf4-a53f-0f086f793e9d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:18.405715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:18.406367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:18.406648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:18.406930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] PATH_INFO: `/v3/projects/0fe4d80dfcd04a26bc8a8eeeb9b32fc3` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:18.408100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe4d80dfcd04a26bc8a8eeeb9b32fc3)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:18.410002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:18.462544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe4d80dfcd04a26bc8a8eeeb9b32fc3', 'request_id': 'req-6a8d4e26-89c5-41f7-824a-373344f3dd53'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:18.487889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe4d80dfcd04a26bc8a8eeeb9b32fc3', 'request_id': 'req-6a8d4e26-89c5-41f7-824a-373344f3dd53'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:18.487889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe4d80dfcd04a26bc8a8eeeb9b32fc3', 'request_id': 'req-6a8d4e26-89c5-41f7-824a-373344f3dd53'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:18.488453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:18.496350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] The token cache is being invalidate because project 0fe4d80dfcd04a26bc8a8eeeb9b32fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:18.496968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:18.498224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-6a8d4e26-89c5-41f7-824a-373344f3dd53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:18.499956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1090/2209] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:18 2022] DELETE /identity/v3/projects/0fe4d80dfcd04a26bc8a8eeeb9b32fc3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:18.505091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e3dc-5f8c-4440-acb1-6a82233a5777 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:18.505346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e3dc-5f8c-4440-acb1-6a82233a5777 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:18.505603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e3dc-5f8c-4440-acb1-6a82233a5777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:18.537326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9985e3dc-5f8c-4440-acb1-6a82233a5777 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:18.538727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9985e3dc-5f8c-4440-acb1-6a82233a5777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:18.613571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1120/2210] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:18.621832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc48fb-847b-4e55-91dd-54b2941412f5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:18.622337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc48fb-847b-4e55-91dd-54b2941412f5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:18.622591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc48fb-847b-4e55-91dd-54b2941412f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:18.648917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-52dc48fb-847b-4e55-91dd-54b2941412f5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:18.650566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-52dc48fb-847b-4e55-91dd-54b2941412f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:18.661220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1091/2211] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:18.667761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985e3dc-5f8c-4440-acb1-6a82233a5777 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:18.698134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985e3dc-5f8c-4440-acb1-6a82233a5777 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:18.719314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:18.719314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:18.719314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:18.719314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:18.720055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:18.720444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:18.722151 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:18.737087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1121/2212] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:18.743087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc48fb-847b-4e55-91dd-54b2941412f5 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:18.776916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc48fb-847b-4e55-91dd-54b2941412f5 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:18.795663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:18.796510 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:18.796804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:18.797075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:18.797722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:18.802962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:18.874654 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1092/2213] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:18 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:18.879958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:18.891934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d16b0-332a-4b2b-adfa-c37df65f72c9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:18.906183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:19.009285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.010104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.010634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.011309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.012661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.015171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.049951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1122/2214] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:18 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:19.054782 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.069697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3837b-4903-44bf-87de-15ec3e0c5409 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.079244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.080102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.080453 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.080792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.081657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.086420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.105165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1093/2215] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:19.110005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.123534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfe8a6-98ce-4fcb-85b3-ea14544fd45e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.131770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0582f-3cba-4c06-8fa6-5c248339519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.132766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0582f-3cba-4c06-8fa6-5c248339519f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.133225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0582f-3cba-4c06-8fa6-5c248339519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.133686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0582f-3cba-4c06-8fa6-5c248339519f admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.134861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0582f-3cba-4c06-8fa6-5c248339519f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.138420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0582f-3cba-4c06-8fa6-5c248339519f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.159918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1123/2216] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:19.167814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.192117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a69e-3ae5-4a29-902e-f72d032ee52d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.197832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.198633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.198911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.199179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] PATH_INFO: `/v3/projects/0857ced49f81425da5995c9c312f41c7/users/376831ae87a840aca5522aa56c8a8ca2/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.217145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0857ced49f81425da5995c9c312f41c7, user_id=376831ae87a840aca5522aa56c8a8ca2, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.220863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.251083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1094/2217] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:19 2022] PUT /identity/v3/projects/0857ced49f81425da5995c9c312f41c7/users/376831ae87a840aca5522aa56c8a8ca2/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:19.256606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735949e-e14d-4eb2-8cec-79b4cc918c00 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.257091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735949e-e14d-4eb2-8cec-79b4cc918c00 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.257451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735949e-e14d-4eb2-8cec-79b4cc918c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.294061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7735949e-e14d-4eb2-8cec-79b4cc918c00 None None] MFA Rules not processed for user `376831ae87a840aca5522aa56c8a8ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:19.295291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7735949e-e14d-4eb2-8cec-79b4cc918c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:19.381833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1124/2218] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:19.383141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.452918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ebd3b-2080-4330-9f1c-c00c7166d4c1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.457776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.458391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.458667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.458936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.459571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.461524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.490375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1095/2219] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:19 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:19.494521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735949e-e14d-4eb2-8cec-79b4cc918c00 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.505966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735949e-e14d-4eb2-8cec-79b4cc918c00 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.573341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.574098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.574534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.574932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.575590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.577616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.608320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1125/2220] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:19 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:19.609585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.619824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88c35b-4262-4e52-82df-ada791894b1e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.625452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.626082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.626314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.626606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.627245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.629017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.640895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1096/2221] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:19.645314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.656487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eb35e-93c5-4fd0-83d2-fd199a819a05 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.664101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.665121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.665545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.665998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] PATH_INFO: `/v3/projects/883e4320fcaa42b58047deae788d285f/users/2b3b8a77f6b04a46988d1663d5ede840/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.671016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:19.685336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883e4320fcaa42b58047deae788d285f, user_id=2b3b8a77f6b04a46988d1663d5ede840, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.688023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.702341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1126/2222] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:19 2022] PUT /identity/v3/projects/883e4320fcaa42b58047deae788d285f/users/2b3b8a77f6b04a46988d1663d5ede840/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:19.706357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.716844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cffca2-de09-40dd-ac73-fcc893f26dde admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.779307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa247c3e-95fb-4672-bc35-75a9d75b77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.779867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa247c3e-95fb-4672-bc35-75a9d75b77c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.780150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa247c3e-95fb-4672-bc35-75a9d75b77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.780425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa247c3e-95fb-4672-bc35-75a9d75b77c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.781064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa247c3e-95fb-4672-bc35-75a9d75b77c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.782700 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa247c3e-95fb-4672-bc35-75a9d75b77c8 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.793021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1097/2223] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:19.797640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.808089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850b121-d1c5-4ec1-af76-861b5f760584 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:19.812918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:19.813580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.813853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.814118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] PATH_INFO: `/v3/projects/883e4320fcaa42b58047deae788d285f/users/2b3b8a77f6b04a46988d1663d5ede840/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.816175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883e4320fcaa42b58047deae788d285f, user_id=2b3b8a77f6b04a46988d1663d5ede840, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:19.818802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:19.833044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1127/2224] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:19 2022] PUT /identity/v3/projects/883e4320fcaa42b58047deae788d285f/users/2b3b8a77f6b04a46988d1663d5ede840/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:19.843543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546475d-e21c-4df2-b8d9-1522412ec7b7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:19.844208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546475d-e21c-4df2-b8d9-1522412ec7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:19.844567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546475d-e21c-4df2-b8d9-1522412ec7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:19.862594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:19.880301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a546475d-e21c-4df2-b8d9-1522412ec7b7 None None] MFA Rules not processed for user `2b3b8a77f6b04a46988d1663d5ede840`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:19.882149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a546475d-e21c-4df2-b8d9-1522412ec7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:19.955681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1098/2225] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:19.970181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:19.972364 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:20.033924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec467d-649a-415d-9d68-5943c7451547 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:20.038238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:20.038841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:20.039111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:20.039378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:20.049363 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:20.050780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:20.060438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1128/2226] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:20.527865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546475d-e21c-4df2-b8d9-1522412ec7b7 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:20.539399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546475d-e21c-4df2-b8d9-1522412ec7b7 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:20.544633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b8a77f6b04a46988d1663d5ede840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883e4320fcaa42b58047deae788d285f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:20.545390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:20.545776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:20.546167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:20.546932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:20.547334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:20.549410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:20.563142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1099/2227] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:20.567494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:20.577530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e59d2-4772-48a0-bd4a-eba5317b1a2c service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:20.583679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b8a77f6b04a46988d1663d5ede840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883e4320fcaa42b58047deae788d285f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:20.584385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:20.584711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:20.584983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:20.585733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:20.588532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:20.620847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1129/2228] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:20 2022] POST /identity/v3/projects => generated 353 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:20.624887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:20.645330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d0a14-9bce-4bbf-b4bd-2c6a842e020e tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:20.744066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b8a77f6b04a46988d1663d5ede840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883e4320fcaa42b58047deae788d285f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:20.744852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:20.745168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:20.745490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:20.746297 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:20.746603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:20.748552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:20.766958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1100/2229] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:00:20.813467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:20.823922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d971b79-9483-4550-b0ab-479dce5e5ddb tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:20.828867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b3b8a77f6b04a46988d1663d5ede840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '883e4320fcaa42b58047deae788d285f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:20.829515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:20.829797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:20.830068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] PATH_INFO: `/v3/projects/c3a68a53de6c4cc4a07a16f3db109d92` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:20.831315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c3a68a53de6c4cc4a07a16f3db109d92)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:20.833129 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:20.884453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a68a53de6c4cc4a07a16f3db109d92', 'request_id': 'req-649e53ae-c60f-4628-ab6b-2edaf4745c13'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:20.893762 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a68a53de6c4cc4a07a16f3db109d92', 'request_id': 'req-649e53ae-c60f-4628-ab6b-2edaf4745c13'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:20.900746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a68a53de6c4cc4a07a16f3db109d92', 'request_id': 'req-649e53ae-c60f-4628-ab6b-2edaf4745c13'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:20.914493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] The token cache is being invalidate because project c3a68a53de6c4cc4a07a16f3db109d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:20.914773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:20.915438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-649e53ae-c60f-4628-ab6b-2edaf4745c13 tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:20.917249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1130/2230] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:20 2022] DELETE /identity/v3/projects/c3a68a53de6c4cc4a07a16f3db109d92 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:21.144572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:21.147438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:21.247210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73356f3-c1ec-4a7e-91ed-7ae3b9e92b5a tempest-VolumeQuotaClassesTest-1755666979 tempest-VolumeQuotaClassesTest-1755666979-project-admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:21.264281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:21.305275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:21.305830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:21.306108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:21.306378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] PATH_INFO: `/v3/users/376831ae87a840aca5522aa56c8a8ca2` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:21.307508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376831ae87a840aca5522aa56c8a8ca2)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:21.311061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:21.367431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376831ae87a840aca5522aa56c8a8ca2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:21.380968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376831ae87a840aca5522aa56c8a8ca2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:21.381794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376831ae87a840aca5522aa56c8a8ca2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:21.382873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376831ae87a840aca5522aa56c8a8ca2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:21.392822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376831ae87a840aca5522aa56c8a8ca2'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:21.425029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1101/2231] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:21 2022] DELETE /identity/v3/users/376831ae87a840aca5522aa56c8a8ca2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:21.430070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:21.430551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:21.430802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:21.453942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:21.455573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:21.502165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:21.538351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1131/2232] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:21.548948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:21.550848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:21.618992 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae7aaf-b349-45d5-b779-1dfbe3ca6049 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:21.622878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:21.623517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:21.623825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:21.624095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:21.633330 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:21.634742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:21.645367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1102/2233] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:22.152702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:22.154370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:22.166545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fac93c-e605-47b4-9424-2facdb3a6333 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:22.186689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:22.187435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:22.187809 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:22.189413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] PATH_INFO: `/v3/projects/0857ced49f81425da5995c9c312f41c7` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:22.192194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0857ced49f81425da5995c9c312f41c7)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:22.194028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:22.250148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0857ced49f81425da5995c9c312f41c7', 'request_id': 'req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.257822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0857ced49f81425da5995c9c312f41c7', 'request_id': 'req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.264466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0857ced49f81425da5995c9c312f41c7', 'request_id': 'req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.276360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] The token cache is being invalidate because project 0857ced49f81425da5995c9c312f41c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:22.276653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.277389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.281930 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1132/2234] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:22 2022] DELETE /identity/v3/projects/0857ced49f81425da5995c9c312f41c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:22.283264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:22.293740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae1f5-5ccd-41fd-b544-e47b6a12ce66 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:22.337976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:22.364952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:22.365641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:22.366046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:22.366403 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] PATH_INFO: `/v3/users/2b3b8a77f6b04a46988d1663d5ede840` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:22.367439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3b8a77f6b04a46988d1663d5ede840)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:22.369385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:22.423434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3b8a77f6b04a46988d1663d5ede840'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.434551 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3b8a77f6b04a46988d1663d5ede840'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.435489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3b8a77f6b04a46988d1663d5ede840'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.436117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3b8a77f6b04a46988d1663d5ede840'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.457666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f39b4748-dcb6-4687-bbe7-63f0f590f27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3b8a77f6b04a46988d1663d5ede840'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.479659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1103/2235] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:22 2022] DELETE /identity/v3/users/2b3b8a77f6b04a46988d1663d5ede840 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:22.798681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:22.800186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:22.813243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd1ebb-52ea-47c6-a9db-8aa378c759ca admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:22.874311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:22.874964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:22.875243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:22.875516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] PATH_INFO: `/v3/projects/883e4320fcaa42b58047deae788d285f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:22.876699 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=883e4320fcaa42b58047deae788d285f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:22.878620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:22.927529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883e4320fcaa42b58047deae788d285f', 'request_id': 'req-8a53fd29-282c-49f8-af65-30755935f31f'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.936602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883e4320fcaa42b58047deae788d285f', 'request_id': 'req-8a53fd29-282c-49f8-af65-30755935f31f'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.940694 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:22.943264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883e4320fcaa42b58047deae788d285f', 'request_id': 'req-8a53fd29-282c-49f8-af65-30755935f31f'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.957315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] The token cache is being invalidate because project 883e4320fcaa42b58047deae788d285f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:22.957972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.958984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8a53fd29-282c-49f8-af65-30755935f31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:22.960521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1133/2236] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:22 2022] DELETE /identity/v3/projects/883e4320fcaa42b58047deae788d285f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:22.965967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54387827-2748-4415-bc7d-0add41821b47 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:22.965967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54387827-2748-4415-bc7d-0add41821b47 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:22.966616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54387827-2748-4415-bc7d-0add41821b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:22.987432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-54387827-2748-4415-bc7d-0add41821b47 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:22.988681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-54387827-2748-4415-bc7d-0add41821b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:23.050015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1104/2237] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:23.057994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7dca-f597-4a29-b4f3-8ad287efb5e9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.058278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7dca-f597-4a29-b4f3-8ad287efb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.058695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c7dca-f597-4a29-b4f3-8ad287efb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.078055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-792c7dca-f597-4a29-b4f3-8ad287efb5e9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:23.079255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-792c7dca-f597-4a29-b4f3-8ad287efb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:23.087343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1134/2238] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:23.091942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54387827-2748-4415-bc7d-0add41821b47 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.101892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54387827-2748-4415-bc7d-0add41821b47 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.106727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.107333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.107617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.107897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.108546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:23.108836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.110429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.125898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1105/2239] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:23.126686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7dca-f597-4a29-b4f3-8ad287efb5e9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.136815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c7dca-f597-4a29-b4f3-8ad287efb5e9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.142850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.143622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.143934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.144200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.144834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.146755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.182935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1135/2240] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:23 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:23.184017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.195196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b5ec9-7667-441b-a151-626eb3bf31a0 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.241943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:23.256448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.257072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.257687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.257687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.258355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.260478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.286535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1106/2241] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:23 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:23.290789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.301199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402824bd-25e3-42f1-9138-252c01cf78f6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.306000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.306607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.306867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.307136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.307825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.309539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.319448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1136/2242] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:23.323368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.333639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fd878-f9d3-40de-b208-23b3e686f770 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.338706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5055c-6e40-4e49-9371-f53b16185024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.339301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5055c-6e40-4e49-9371-f53b16185024 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.339574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5055c-6e40-4e49-9371-f53b16185024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.339990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5055c-6e40-4e49-9371-f53b16185024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.340598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5055c-6e40-4e49-9371-f53b16185024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.342174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5055c-6e40-4e49-9371-f53b16185024 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.353744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1107/2243] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:23.358209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.368925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f3bb4-c5da-4b58-976b-28be3c7b44cd admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.374502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.375181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.375458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.375787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] PATH_INFO: `/v3/projects/af19d8ed9ed842f58f604b5111833452/users/353f63c742d84fc281d35693940e7b55/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.391985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af19d8ed9ed842f58f604b5111833452, user_id=353f63c742d84fc281d35693940e7b55, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.394567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.410791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1137/2244] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:23 2022] PUT /identity/v3/projects/af19d8ed9ed842f58f604b5111833452/users/353f63c742d84fc281d35693940e7b55/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:23.424875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67540e-a8fd-4462-94ef-48d7f83aa0b2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.425176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67540e-a8fd-4462-94ef-48d7f83aa0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.425442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67540e-a8fd-4462-94ef-48d7f83aa0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.456994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2f67540e-a8fd-4462-94ef-48d7f83aa0b2 None None] MFA Rules not processed for user `353f63c742d84fc281d35693940e7b55`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:23.458222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2f67540e-a8fd-4462-94ef-48d7f83aa0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:23.525806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1108/2245] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:23.530382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.602786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3de61-7921-49f0-afed-21d3f33d297b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.608480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.609125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.609396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.609656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.610300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.612276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.651932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1138/2246] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:23 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:23.652068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67540e-a8fd-4462-94ef-48d7f83aa0b2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.660171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67540e-a8fd-4462-94ef-48d7f83aa0b2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.728025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.728788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.729116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.729446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.730063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.732333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.758903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1109/2247] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:23 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:23.763791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.778087 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b1198-ce64-4fe1-961d-ed4bf46df322 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.783038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.783658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.783964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.784237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.784884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.786520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.807541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1139/2248] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:23.812355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.827491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fe24-7ee3-4b4b-9bd9-8da9504cf339 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.834555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.835492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.836076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.836514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] PATH_INFO: `/v3/projects/d54f38e9a9804d38bd532f9cea0b357f/users/d2902de24a75460c8317e438da81d626/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.854405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54f38e9a9804d38bd532f9cea0b357f, user_id=d2902de24a75460c8317e438da81d626, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.857469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.873316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1110/2249] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:23 2022] PUT /identity/v3/projects/d54f38e9a9804d38bd532f9cea0b357f/users/d2902de24a75460c8317e438da81d626/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:23.877281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.887837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351aa87-f7da-44e2-a94c-2ba3d55cf24b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.951142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7144e9-46dd-46f0-84d8-872397fd0425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.952140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7144e9-46dd-46f0-84d8-872397fd0425 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.952743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7144e9-46dd-46f0-84d8-872397fd0425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.953191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7144e9-46dd-46f0-84d8-872397fd0425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.954186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7144e9-46dd-46f0-84d8-872397fd0425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:23.956085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7144e9-46dd-46f0-84d8-872397fd0425 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:23.958028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:23.977017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1140/2250] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:23.977652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:23.989723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6372-41a6-439c-9e35-c919d6dd65fe admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:23.995606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:23.996399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:23.996676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:23.997142 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] PATH_INFO: `/v3/projects/d54f38e9a9804d38bd532f9cea0b357f/users/d2902de24a75460c8317e438da81d626/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:23.999958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54f38e9a9804d38bd532f9cea0b357f, user_id=d2902de24a75460c8317e438da81d626, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:24.005074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:24.018370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1111/2251] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:23 2022] PUT /identity/v3/projects/d54f38e9a9804d38bd532f9cea0b357f/users/d2902de24a75460c8317e438da81d626/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:24.029370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abfb20-a80a-4341-bb1b-ee7861bd9f7b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:24.029652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abfb20-a80a-4341-bb1b-ee7861bd9f7b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:24.029922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abfb20-a80a-4341-bb1b-ee7861bd9f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:24.076431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-47abfb20-a80a-4341-bb1b-ee7861bd9f7b None None] MFA Rules not processed for user `d2902de24a75460c8317e438da81d626`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:24.078117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-47abfb20-a80a-4341-bb1b-ee7861bd9f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:24.174002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1141/2252] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:24.187583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:24.193298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:24.213786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:24.283660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6cd4b-b17d-4101-896c-ab9d6ce51139 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:24.287583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1161-ae64-4bf1-be95-3d7c5bdf02fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:24.288437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1161-ae64-4bf1-be95-3d7c5bdf02fc service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:24.288791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1161-ae64-4bf1-be95-3d7c5bdf02fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:24.288987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1161-ae64-4bf1-be95-3d7c5bdf02fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:24.305714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc1161-ae64-4bf1-be95-3d7c5bdf02fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:24.307926 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc1161-ae64-4bf1-be95-3d7c5bdf02fc service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:24.322984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1112/2253] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:24.494928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abfb20-a80a-4341-bb1b-ee7861bd9f7b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:24.592047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abfb20-a80a-4341-bb1b-ee7861bd9f7b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:24.597607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:24.598469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:24.598812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:24.599169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] PATH_INFO: `/v3/users/353f63c742d84fc281d35693940e7b55` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:24.600455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=353f63c742d84fc281d35693940e7b55)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:24.602557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:24.690620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353f63c742d84fc281d35693940e7b55'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:24.721993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353f63c742d84fc281d35693940e7b55'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:24.732021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353f63c742d84fc281d35693940e7b55'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:24.732833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353f63c742d84fc281d35693940e7b55'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:24.746367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353f63c742d84fc281d35693940e7b55'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:24.750576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:24.756026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1142/2254] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:24 2022] DELETE /identity/v3/users/353f63c742d84fc281d35693940e7b55 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:24.761189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:24.761640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:24.761915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:24.783241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:24.785275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:24.857201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1113/2255] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:24.868517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:24.870372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:24.939431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5eab-f5ef-49cd-8f51-ae0d00611eee admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:24.943199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:24.943856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:24.944141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:24.944410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:24.957007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:24.958484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:24.969865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1143/2256] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:25.256902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:25.258376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:25.290275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2fed8-8120-431d-a105-31bdb893f90c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:25.295270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:25.296000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:25.296281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:25.297117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] PATH_INFO: `/v3/projects/af19d8ed9ed842f58f604b5111833452` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:25.297913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af19d8ed9ed842f58f604b5111833452)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:25.299977 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:25.361236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af19d8ed9ed842f58f604b5111833452', 'request_id': 'req-2740a250-5241-4785-a8a5-432cff64be0b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.375784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af19d8ed9ed842f58f604b5111833452', 'request_id': 'req-2740a250-5241-4785-a8a5-432cff64be0b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.383959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af19d8ed9ed842f58f604b5111833452', 'request_id': 'req-2740a250-5241-4785-a8a5-432cff64be0b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.400349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] The token cache is being invalidate because project af19d8ed9ed842f58f604b5111833452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:25.400689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.401329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-2740a250-5241-4785-a8a5-432cff64be0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.407534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1114/2257] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:25 2022] DELETE /identity/v3/projects/af19d8ed9ed842f58f604b5111833452 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:25.408683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:25.418867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a991-a40c-486a-ba34-c86541313563 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:25.487968 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:25.488631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:25.488906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:25.489177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] PATH_INFO: `/v3/users/d2902de24a75460c8317e438da81d626` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:25.490386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2902de24a75460c8317e438da81d626)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:25.492436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:25.562889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2902de24a75460c8317e438da81d626'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.576890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2902de24a75460c8317e438da81d626'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.595781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2902de24a75460c8317e438da81d626'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.597064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2902de24a75460c8317e438da81d626'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.613140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2902de24a75460c8317e438da81d626'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:25.623849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1144/2258] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:25 2022] DELETE /identity/v3/users/d2902de24a75460c8317e438da81d626 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:25.628076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:25.628435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:25.628631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:25.654474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:25.655564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:25.701527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:25.736146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1115/2259] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:25.800419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:25.802922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:25.850409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:25.979218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcaff4-d698-4487-97a5-d68e0af4bc47 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:25.997291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809814e1-81a1-4aba-901c-1574dbb2d448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:25.998587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809814e1-81a1-4aba-901c-1574dbb2d448 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.000392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809814e1-81a1-4aba-901c-1574dbb2d448 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.000845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809814e1-81a1-4aba-901c-1574dbb2d448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.030066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809814e1-81a1-4aba-901c-1574dbb2d448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:26.034368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809814e1-81a1-4aba-901c-1574dbb2d448 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:26.064127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1145/2260] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:00:26.104200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:26.105994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:26.232076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe05fe-7029-4b3e-95a9-e0c86af1906e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:26.238237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:26.238902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.239182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.239458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] PATH_INFO: `/v3/projects/d54f38e9a9804d38bd532f9cea0b357f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.240873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54f38e9a9804d38bd532f9cea0b357f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:26.243686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:26.312629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54f38e9a9804d38bd532f9cea0b357f', 'request_id': 'req-56628305-8586-46ff-8500-41deba72c702'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:26.327210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54f38e9a9804d38bd532f9cea0b357f', 'request_id': 'req-56628305-8586-46ff-8500-41deba72c702'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:26.336509 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54f38e9a9804d38bd532f9cea0b357f', 'request_id': 'req-56628305-8586-46ff-8500-41deba72c702'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:26.355914 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] The token cache is being invalidate because project d54f38e9a9804d38bd532f9cea0b357f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:26.356368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:26.357227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-56628305-8586-46ff-8500-41deba72c702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:26.362749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1116/2261] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:26 2022] DELETE /identity/v3/projects/d54f38e9a9804d38bd532f9cea0b357f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:26.364643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3539d-ee56-458d-98a1-cc8f2050c138 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.364937 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3539d-ee56-458d-98a1-cc8f2050c138 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.365219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3539d-ee56-458d-98a1-cc8f2050c138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.395222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3bf3539d-ee56-458d-98a1-cc8f2050c138 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:26.396450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3bf3539d-ee56-458d-98a1-cc8f2050c138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:26.522984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1146/2262] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:26.531673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9d86-aa16-4592-8b45-3a154d7080e3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.532212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9d86-aa16-4592-8b45-3a154d7080e3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.532588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9d86-aa16-4592-8b45-3a154d7080e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.589936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8f6b9d86-aa16-4592-8b45-3a154d7080e3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:26.591305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8f6b9d86-aa16-4592-8b45-3a154d7080e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:26.608493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1117/2263] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:26.612666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3539d-ee56-458d-98a1-cc8f2050c138 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:26.622771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3539d-ee56-458d-98a1-cc8f2050c138 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:26.636045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:26.636853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.637317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.637590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.638239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:26.638531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:26.640188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:26.679775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b9d86-aa16-4592-8b45-3a154d7080e3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:26.683731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1147/2264] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:00:26.695504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b9d86-aa16-4592-8b45-3a154d7080e3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:26.701915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:26.702655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.703039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.703272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.704097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:26.706522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:26.748200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:26.749987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1118/2265] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:26 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:26.763049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622f0a7-1927-49be-8919-24d4ae059d2f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:26.894670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:26.895338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.895616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.895913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.896546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:26.899623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:26.937890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1148/2266] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:26 2022] POST /identity/v3/users => generated 305 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:26.942122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:26.961187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ef7b-7fc2-494a-b583-346fb5477d42 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:26.966900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:26.967572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:26.967878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:26.968149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:26.969127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:26.970744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:26.985958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1119/2267] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:26.989673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:27.008744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e729aa-5331-42fa-a5bb-15596f386117 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:27.020014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64133a-72eb-48c0-b78b-3779776f8a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:27.021473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64133a-72eb-48c0-b78b-3779776f8a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:27.021833 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64133a-72eb-48c0-b78b-3779776f8a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:27.022361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64133a-72eb-48c0-b78b-3779776f8a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:27.023549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64133a-72eb-48c0-b78b-3779776f8a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:27.026744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64133a-72eb-48c0-b78b-3779776f8a28 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:27.057954 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1149/2268] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:27.058909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:27.096940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d173c9-819d-4d32-8d28-38d24bc1935c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:27.112266 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:27.115797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:27.116260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:27.116684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] PATH_INFO: `/v3/projects/4704e8a754d04ebe8cf45a0380e92c56/users/cc1bae7a152f4f17896397572fecb2b1/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:27.173864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4704e8a754d04ebe8cf45a0380e92c56, user_id=cc1bae7a152f4f17896397572fecb2b1, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:27.180575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:27.211048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1120/2269] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:27 2022] PUT /identity/v3/projects/4704e8a754d04ebe8cf45a0380e92c56/users/cc1bae7a152f4f17896397572fecb2b1/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:27.233309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0109ef-ef5e-4e01-a548-42e4f3c98157 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:27.233763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0109ef-ef5e-4e01-a548-42e4f3c98157 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:27.234147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0109ef-ef5e-4e01-a548-42e4f3c98157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:27.348812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5d0109ef-ef5e-4e01-a548-42e4f3c98157 None None] MFA Rules not processed for user `cc1bae7a152f4f17896397572fecb2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:27.350128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5d0109ef-ef5e-4e01-a548-42e4f3c98157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:27.374478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:27.483613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1150/2270] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:27 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:27.488508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:27.503021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:27.618684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af99b2-9be8-4a5d-8538-58def9e197ab admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:27.629469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:27.630185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:27.630512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:27.631223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:27.632512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:27.635527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:27.704023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1121/2271] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:27 2022] POST /identity/v3/projects => generated 409 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:27.707831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0109ef-ef5e-4e01-a548-42e4f3c98157 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:27.724697 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0109ef-ef5e-4e01-a548-42e4f3c98157 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:27.869543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:27.870191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:27.870463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:27.870790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:27.871535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:27.873902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:27.908376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1151/2272] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:27 2022] POST /identity/v3/users => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:27.913076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:27.937676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee3e08-88d0-40e5-bf84-0cc02f13f52f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:27.945366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:27.946071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:27.946567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:27.946927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:27.947747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:27.949476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:28.121308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:28.125742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1122/2273] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:28.165552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105b3ca-989b-4817-82fc-9a5fa530b29e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:28.174243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:28.174932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:28.175210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:28.175480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] PATH_INFO: `/v3/projects/6f5451cf8796460491d64e63b3013ff8/users/0fc85264b6bb48a2859ed6611f2c3e67/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:28.221071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5451cf8796460491d64e63b3013ff8, user_id=0fc85264b6bb48a2859ed6611f2c3e67, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:28.224357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:28.244516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1152/2274] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:28 2022] PUT /identity/v3/projects/6f5451cf8796460491d64e63b3013ff8/users/0fc85264b6bb48a2859ed6611f2c3e67/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:28.248197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:28.263911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b97b07-2b56-46eb-85a5-25647fa83b23 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:28.343001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff0fa9-0221-4ca2-ba20-ebb186c55a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:28.343920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0fa9-0221-4ca2-ba20-ebb186c55a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:28.344221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0fa9-0221-4ca2-ba20-ebb186c55a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:28.344492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff0fa9-0221-4ca2-ba20-ebb186c55a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:28.345286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff0fa9-0221-4ca2-ba20-ebb186c55a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:28.347761 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff0fa9-0221-4ca2-ba20-ebb186c55a40 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:28.361193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1123/2275] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:28.365843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:28.416074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bdb4-d6bd-48d7-9425-680c4c826e98 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:28.426724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:28.428679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:28.428974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:28.429590 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] PATH_INFO: `/v3/projects/6f5451cf8796460491d64e63b3013ff8/users/0fc85264b6bb48a2859ed6611f2c3e67/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:28.437138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5451cf8796460491d64e63b3013ff8, user_id=0fc85264b6bb48a2859ed6611f2c3e67, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:28.441658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:28.469285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1153/2276] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:28 2022] PUT /identity/v3/projects/6f5451cf8796460491d64e63b3013ff8/users/0fc85264b6bb48a2859ed6611f2c3e67/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:28.483782 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8feb1-7b93-4e0e-91e6-2cdad6267e39 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:28.484072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8feb1-7b93-4e0e-91e6-2cdad6267e39 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:28.484338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8feb1-7b93-4e0e-91e6-2cdad6267e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:28.547574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b7a8feb1-7b93-4e0e-91e6-2cdad6267e39 None None] MFA Rules not processed for user `0fc85264b6bb48a2859ed6611f2c3e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:28.556833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b7a8feb1-7b93-4e0e-91e6-2cdad6267e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:28.744633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1124/2277] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:28.773899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:28.784164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:28.844740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572348-dc13-4cc0-8335-3775a802baac admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:28.848212 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:28.848817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:28.849086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:28.849346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:28.858063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:28.859492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:28.869908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1154/2278] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:28 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:29.074758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8feb1-7b93-4e0e-91e6-2cdad6267e39 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:29.082964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:29.102613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8feb1-7b93-4e0e-91e6-2cdad6267e39 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:29.119963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff89ca9-1809-4b38-b3ae-b49bf923de44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:29.121623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89ca9-1809-4b38-b3ae-b49bf923de44 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:29.122023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89ca9-1809-4b38-b3ae-b49bf923de44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:29.122557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89ca9-1809-4b38-b3ae-b49bf923de44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:29.211557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff89ca9-1809-4b38-b3ae-b49bf923de44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:29.213350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff89ca9-1809-4b38-b3ae-b49bf923de44 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:29.236105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1125/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:29 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:34.931931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:34.936608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:35.021036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014a81d-a746-46e4-845b-eae8245306c8 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:35.028448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:35.028813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:35.035826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:35.035826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] PATH_INFO: `/v3/users/cc1bae7a152f4f17896397572fecb2b1` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:35.035826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1bae7a152f4f17896397572fecb2b1)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:35.035826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:35.315170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1bae7a152f4f17896397572fecb2b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:35.328979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1bae7a152f4f17896397572fecb2b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:35.340259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1bae7a152f4f17896397572fecb2b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:35.341469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1bae7a152f4f17896397572fecb2b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:35.358642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1bae7a152f4f17896397572fecb2b1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:35.365871 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1155/2280] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:34 2022] DELETE /identity/v3/users/cc1bae7a152f4f17896397572fecb2b1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:35.373704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:35.374778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:35.375220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:35.399633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:35.401409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:35.491907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1126/2281] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:35.499912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:35.513656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:35.580973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b482ec7-ac9d-4822-aca2-212c5686a930 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:35.585270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:35.586249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:35.588336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:35.588598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:35.604272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:35.605923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:35.628015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1156/2282] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:36.022298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:36.024479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:36.051217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb668678-7dfb-4dd9-8d41-64293bfb7160 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:36.058707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:36.059494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:36.059946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:36.060696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] PATH_INFO: `/v3/projects/4704e8a754d04ebe8cf45a0380e92c56` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:36.062716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4704e8a754d04ebe8cf45a0380e92c56)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:36.065420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:36.120978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4704e8a754d04ebe8cf45a0380e92c56', 'request_id': 'req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.133428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4704e8a754d04ebe8cf45a0380e92c56', 'request_id': 'req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.140862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4704e8a754d04ebe8cf45a0380e92c56', 'request_id': 'req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.154267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] The token cache is being invalidate because project 4704e8a754d04ebe8cf45a0380e92c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:36.154635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.155367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.157202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1127/2283] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:36 2022] DELETE /identity/v3/projects/4704e8a754d04ebe8cf45a0380e92c56 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:36.161789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:36.175553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05c87d-fbb9-46dd-b22b-49e6503944c3 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:36.200517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:36.249709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:36.250595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:36.250864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:36.251202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] PATH_INFO: `/v3/users/0fc85264b6bb48a2859ed6611f2c3e67` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:36.252790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc85264b6bb48a2859ed6611f2c3e67)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:36.255136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:36.311160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc85264b6bb48a2859ed6611f2c3e67'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.320232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc85264b6bb48a2859ed6611f2c3e67'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.330011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc85264b6bb48a2859ed6611f2c3e67'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.330794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc85264b6bb48a2859ed6611f2c3e67'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.347405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9bd3066f-2d9a-41a2-9e7f-1e5ba4579e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc85264b6bb48a2859ed6611f2c3e67'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:36.354179 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1157/2284] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:36 2022] DELETE /identity/v3/users/0fc85264b6bb48a2859ed6611f2c3e67 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:36.741681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:36.743784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:36.782346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced4795-cac7-458b-9ea9-1f4e9fd5a45b admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:36.846216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:36.927514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:36.928192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:36.928459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:36.928736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] PATH_INFO: `/v3/projects/6f5451cf8796460491d64e63b3013ff8` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:36.929893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5451cf8796460491d64e63b3013ff8)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:36.931900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.004064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5451cf8796460491d64e63b3013ff8', 'request_id': 'req-7a5e5d8d-3b04-4611-8801-1168d43a7910'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:37.019827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5451cf8796460491d64e63b3013ff8', 'request_id': 'req-7a5e5d8d-3b04-4611-8801-1168d43a7910'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:37.037564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5451cf8796460491d64e63b3013ff8', 'request_id': 'req-7a5e5d8d-3b04-4611-8801-1168d43a7910'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:37.077550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] The token cache is being invalidate because project 6f5451cf8796460491d64e63b3013ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:37.077949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:37.078630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7a5e5d8d-3b04-4611-8801-1168d43a7910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:37.081095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1128/2285] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:36 2022] DELETE /identity/v3/projects/6f5451cf8796460491d64e63b3013ff8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:37.094186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3def2-516b-4cd0-8a90-69d06a0493bf None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.094587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3def2-516b-4cd0-8a90-69d06a0493bf None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.094960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3def2-516b-4cd0-8a90-69d06a0493bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.123410 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-17b3def2-516b-4cd0-8a90-69d06a0493bf None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:37.124724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-17b3def2-516b-4cd0-8a90-69d06a0493bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:37.206188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1158/2286] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:37.215199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8d8e-a82f-465f-9261-659e8fb898db None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.215505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8d8e-a82f-465f-9261-659e8fb898db None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.216007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be8d8e-a82f-465f-9261-659e8fb898db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.239130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a0be8d8e-a82f-465f-9261-659e8fb898db None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:37.240392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a0be8d8e-a82f-465f-9261-659e8fb898db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:37.248862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1129/2287] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:37.253393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3def2-516b-4cd0-8a90-69d06a0493bf None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.263613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3def2-516b-4cd0-8a90-69d06a0493bf None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.268650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.269358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.269707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.270052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.270772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:37.271083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.272863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.287069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1159/2288] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:37.291637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8d8e-a82f-465f-9261-659e8fb898db None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.302564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be8d8e-a82f-465f-9261-659e8fb898db None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.310249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.311527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.312209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.312461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.313437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.316834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.359739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1130/2289] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:37 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:37.362835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.380533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76379-a966-4b33-88ce-ef92b76af467 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.414470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:37.451296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.452123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.452386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.452729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.453456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.455532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.485811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1160/2290] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:37 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:37.490515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.501743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecec434-806b-4da4-b00f-747b07762f2c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.507440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.508169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.508492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.508830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.509545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.511540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.523180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1131/2291] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:37.527276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.543299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2bd5e-3716-44f6-b1d4-498d7f24d170 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.550312 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121f1d6-d3a3-4fde-b3c2-43e5b48654f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.551099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121f1d6-d3a3-4fde-b3c2-43e5b48654f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.551463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121f1d6-d3a3-4fde-b3c2-43e5b48654f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.551988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121f1d6-d3a3-4fde-b3c2-43e5b48654f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.552415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121f1d6-d3a3-4fde-b3c2-43e5b48654f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.554044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121f1d6-d3a3-4fde-b3c2-43e5b48654f0 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.566077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1161/2292] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:37.570366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.580891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f2c5-9eb1-49b6-8dc0-06948e1076ca admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.585625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.586394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.586682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.586971 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] PATH_INFO: `/v3/projects/acbbd8811ed9476dbfd0be2a22d312f3/users/b2b18881895447aebe379cd07156b3d7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.603183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbbd8811ed9476dbfd0be2a22d312f3, user_id=b2b18881895447aebe379cd07156b3d7, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.605934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.622315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1132/2293] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:37 2022] PUT /identity/v3/projects/acbbd8811ed9476dbfd0be2a22d312f3/users/b2b18881895447aebe379cd07156b3d7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:37.634123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296be16-9fd7-457c-bc67-4b2d45d5fa52 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.634453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296be16-9fd7-457c-bc67-4b2d45d5fa52 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.634753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296be16-9fd7-457c-bc67-4b2d45d5fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.674611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5296be16-9fd7-457c-bc67-4b2d45d5fa52 None None] MFA Rules not processed for user `b2b18881895447aebe379cd07156b3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:37.676703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5296be16-9fd7-457c-bc67-4b2d45d5fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:37.766485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.767056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1162/2294] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:37.825195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:37.844535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcf7b7-c5b8-4a68-81ba-07996ad7c9bf admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.849778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.850408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.850684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.850955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.851590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.853565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:37.887259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1133/2295] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:37 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:37.888333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296be16-9fd7-457c-bc67-4b2d45d5fa52 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:37.900527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296be16-9fd7-457c-bc67-4b2d45d5fa52 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:37.967949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:37.969504 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:37.970021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:37.970502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:37.971589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:37.974511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:38.000702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1163/2296] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:37 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:38.004745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:38.030352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eb279-552f-4583-af81-d93bdee66744 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:38.037130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:38.037838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:38.038117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:38.038384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:38.039053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:38.040696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:38.056830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1134/2297] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:38.058616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:38.069058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cceea-a07d-4e1e-8ab4-9098cbbd5be3 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:38.073888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:38.074701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:38.074969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:38.075234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] PATH_INFO: `/v3/projects/d847da77180242d0bfccac4ebe110c92/users/29a14c054e3848c1a7ffb22cc43414b9/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:38.095470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d847da77180242d0bfccac4ebe110c92, user_id=29a14c054e3848c1a7ffb22cc43414b9, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:38.098175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:38.119852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1164/2298] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:38 2022] PUT /identity/v3/projects/d847da77180242d0bfccac4ebe110c92/users/29a14c054e3848c1a7ffb22cc43414b9/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:38.121474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:38.132099 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e459d2-6f95-45ef-b990-cf10af23d2de admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:38.223004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e1422-9c0d-470b-bd69-09ae883bb16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:38.223662 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e1422-9c0d-470b-bd69-09ae883bb16b admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:38.224028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e1422-9c0d-470b-bd69-09ae883bb16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:38.224313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e1422-9c0d-470b-bd69-09ae883bb16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:38.225043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e1422-9c0d-470b-bd69-09ae883bb16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:38.226638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e1422-9c0d-470b-bd69-09ae883bb16b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:38.241416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1135/2299] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:38.245473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:38.253530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:38.259825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4af56b-2da1-4fb6-94a7-b7998a9211f6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:38.270668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:38.271374 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:38.271630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:38.271934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] PATH_INFO: `/v3/projects/d847da77180242d0bfccac4ebe110c92/users/29a14c054e3848c1a7ffb22cc43414b9/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:38.274072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d847da77180242d0bfccac4ebe110c92, user_id=29a14c054e3848c1a7ffb22cc43414b9, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:38.276858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:38.289793 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1165/2300] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:38 2022] PUT /identity/v3/projects/d847da77180242d0bfccac4ebe110c92/users/29a14c054e3848c1a7ffb22cc43414b9/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:38.302459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8410b4-e3f7-4c3f-b40b-6099ed6eece1 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:38.302935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8410b4-e3f7-4c3f-b40b-6099ed6eece1 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:38.303333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8410b4-e3f7-4c3f-b40b-6099ed6eece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:38.349702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-aa8410b4-e3f7-4c3f-b40b-6099ed6eece1 None None] MFA Rules not processed for user `29a14c054e3848c1a7ffb22cc43414b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:38.350930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-aa8410b4-e3f7-4c3f-b40b-6099ed6eece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:38.435821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1136/2301] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:38.450921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:38.453398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:38.516645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25cd9c-ef6f-40d2-99e1-900ccca88431 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:38.521493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bff860-75ff-4839-b78f-91ae3744b148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:38.522111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff860-75ff-4839-b78f-91ae3744b148 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:38.522386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff860-75ff-4839-b78f-91ae3744b148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:38.522645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff860-75ff-4839-b78f-91ae3744b148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:38.533507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bff860-75ff-4839-b78f-91ae3744b148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:38.534898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bff860-75ff-4839-b78f-91ae3744b148 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:38.550065 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1166/2302] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:39.388515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8410b4-e3f7-4c3f-b40b-6099ed6eece1 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:39.472783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:39.539854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8410b4-e3f7-4c3f-b40b-6099ed6eece1 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:39.547191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:39.548343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:39.548750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:39.549323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] PATH_INFO: `/v3/users/b2b18881895447aebe379cd07156b3d7` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:39.551791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b18881895447aebe379cd07156b3d7)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:39.563797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:39.718769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b18881895447aebe379cd07156b3d7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:39.739785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b18881895447aebe379cd07156b3d7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:39.756778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b18881895447aebe379cd07156b3d7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:39.766410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b18881895447aebe379cd07156b3d7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:39.771318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b18881895447aebe379cd07156b3d7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:39.793815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1137/2303] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:39 2022] DELETE /identity/v3/users/b2b18881895447aebe379cd07156b3d7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:39.798958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:39.799570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:39.799570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:39.820598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:39.821371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:39.890470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1167/2304] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:39.900531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:39.902529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:39.974675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbcd1-49aa-407a-9a5d-4c156b7b3316 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:39.981233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:39.981860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:39.982127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:39.982393 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:39.992353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:39.993788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:40.005953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1138/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:40.315671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:40.317628 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:40.335544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a0999-4bf5-4da8-87b7-354eb19e1db5 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:40.343396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:40.344367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:40.344507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:40.344856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] PATH_INFO: `/v3/projects/acbbd8811ed9476dbfd0be2a22d312f3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:40.346220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbbd8811ed9476dbfd0be2a22d312f3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:40.348396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:40.419497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbbd8811ed9476dbfd0be2a22d312f3', 'request_id': 'req-e4de8c9a-1511-4973-87e4-2f19a113f4b0'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.442901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbbd8811ed9476dbfd0be2a22d312f3', 'request_id': 'req-e4de8c9a-1511-4973-87e4-2f19a113f4b0'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.460303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbbd8811ed9476dbfd0be2a22d312f3', 'request_id': 'req-e4de8c9a-1511-4973-87e4-2f19a113f4b0'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.480575 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] The token cache is being invalidate because project acbbd8811ed9476dbfd0be2a22d312f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:40.481164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.481838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.488455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1168/2306] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:40 2022] DELETE /identity/v3/projects/acbbd8811ed9476dbfd0be2a22d312f3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:40.488700 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:40.502606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bba60-2b86-4bed-b08a-fa982ba595a2 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:40.609378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:40.610036 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:40.610308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:40.610573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] PATH_INFO: `/v3/users/29a14c054e3848c1a7ffb22cc43414b9` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:40.611688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a14c054e3848c1a7ffb22cc43414b9)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:40.613750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:40.624543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:40.696091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a14c054e3848c1a7ffb22cc43414b9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.708978 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a14c054e3848c1a7ffb22cc43414b9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.709965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a14c054e3848c1a7ffb22cc43414b9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.710861 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a14c054e3848c1a7ffb22cc43414b9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.732413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c6f612a8-7320-4ccc-913e-3a442421ee3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a14c054e3848c1a7ffb22cc43414b9'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:40.780012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1139/2307] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:40 2022] DELETE /identity/v3/users/29a14c054e3848c1a7ffb22cc43414b9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:41.106337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:41.108467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:41.123556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8c9a-1511-4973-87e4-2f19a113f4b0 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:41.142690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:41.212839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:41.213524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.213939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.214160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] PATH_INFO: `/v3/projects/d847da77180242d0bfccac4ebe110c92` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.215394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d847da77180242d0bfccac4ebe110c92)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:41.217503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:41.277882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd847da77180242d0bfccac4ebe110c92', 'request_id': 'req-5606d258-1290-4c33-8a77-427cb2520a08'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:41.287407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd847da77180242d0bfccac4ebe110c92', 'request_id': 'req-5606d258-1290-4c33-8a77-427cb2520a08'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:41.294099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd847da77180242d0bfccac4ebe110c92', 'request_id': 'req-5606d258-1290-4c33-8a77-427cb2520a08'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:41.306467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] The token cache is being invalidate because project d847da77180242d0bfccac4ebe110c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:41.306827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:41.307903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5606d258-1290-4c33-8a77-427cb2520a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:41.309158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1169/2308] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:41 2022] DELETE /identity/v3/projects/d847da77180242d0bfccac4ebe110c92 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:41.314713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113db08-a9cb-4e32-b894-aa6590db6db3 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.315198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113db08-a9cb-4e32-b894-aa6590db6db3 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.315531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113db08-a9cb-4e32-b894-aa6590db6db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.338787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8113db08-a9cb-4e32-b894-aa6590db6db3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:41.340276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8113db08-a9cb-4e32-b894-aa6590db6db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:41.413745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1140/2309] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:41.424062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bff7e-c055-4534-be64-b87abcbab612 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.424274 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bff7e-c055-4534-be64-b87abcbab612 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.424566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bff7e-c055-4534-be64-b87abcbab612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.453263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-394bff7e-c055-4534-be64-b87abcbab612 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:41.454634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-394bff7e-c055-4534-be64-b87abcbab612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:41.464844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1170/2310] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:41.470134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113db08-a9cb-4e32-b894-aa6590db6db3 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:41.483930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113db08-a9cb-4e32-b894-aa6590db6db3 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:41.490162 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:41.490818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.491199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.491469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.492200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:41.492600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:41.494367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:41.509619 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1141/2311] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:41.514227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bff7e-c055-4534-be64-b87abcbab612 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:41.525631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bff7e-c055-4534-be64-b87abcbab612 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:41.530673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:41.531401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.531527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.531916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.532709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:41.534673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:41.582252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1171/2312] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:41 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:41.586906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:41.602041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796e74-b0b3-4368-a1d1-0442e5b473f9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:41.702218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:41.702786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.703065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.703329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.704003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:41.705983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:41.741960 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1142/2313] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:41 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:41.745282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:41.756127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ce789-36cf-4c4b-98de-c026ddb9c532 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:41.761409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:41.762033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.762309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.762659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.763318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:41.765341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:41.802246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1172/2314] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:41.806564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:41.828135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8947fc-c7fa-4b86-b29b-0d8adaa4eacd admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:41.829032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:41.834716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb92810-cce2-4a3a-97e2-799da00273d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:41.835346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb92810-cce2-4a3a-97e2-799da00273d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.835973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb92810-cce2-4a3a-97e2-799da00273d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.836365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb92810-cce2-4a3a-97e2-799da00273d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.837371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb92810-cce2-4a3a-97e2-799da00273d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:41.839314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb92810-cce2-4a3a-97e2-799da00273d1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:41.853120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1143/2315] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:41.857828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:41.869172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db9475-b92f-49c0-a69a-3b6d73bbe5ad admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:41.874178 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:41.874868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.875149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.875418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] PATH_INFO: `/v3/projects/529d5e3ba15c405582dad2fbf5bfeaa7/users/9204194252d94d4bb4dfe2cc44c65841/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.895333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529d5e3ba15c405582dad2fbf5bfeaa7, user_id=9204194252d94d4bb4dfe2cc44c65841, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:41.898111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:41.916769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1173/2316] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:41 2022] PUT /identity/v3/projects/529d5e3ba15c405582dad2fbf5bfeaa7/users/9204194252d94d4bb4dfe2cc44c65841/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:41.927025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c88398-19a9-4abd-adc8-93321a095898 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:41.927315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c88398-19a9-4abd-adc8-93321a095898 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:41.927583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c88398-19a9-4abd-adc8-93321a095898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:41.969335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-14c88398-19a9-4abd-adc8-93321a095898 None None] MFA Rules not processed for user `9204194252d94d4bb4dfe2cc44c65841`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:41.972310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-14c88398-19a9-4abd-adc8-93321a095898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:42.147505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1144/2317] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:42.148662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:42.250409 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:42.304728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc75dd-6fee-40a0-855d-246834657317 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:42.321501 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:42.325189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:42.327827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:42.328223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:42.329210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:42.335429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:42.392330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1174/2318] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:42 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:42.396070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c88398-19a9-4abd-adc8-93321a095898 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:42.418015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c88398-19a9-4abd-adc8-93321a095898 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:42.548495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:42.549132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:42.549405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:42.549669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:42.550320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:42.552317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:42.575158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1145/2319] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:42 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:42.578895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:42.589423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d646f7-02dd-401a-93b1-d33420b03daa admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:42.594476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:42.595091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:42.595370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:42.595641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:42.596320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:42.597934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:42.609405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1175/2320] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:42.613958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:42.625436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26750c05-9766-4093-a8d1-8b5d8a432c76 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:42.630657 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:42.631362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:42.631630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:42.631959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] PATH_INFO: `/v3/projects/0d8aea888e1d4032904639d4de688486/users/9ebc987ba1e14f39a9319ac8475bd61d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:42.649954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8aea888e1d4032904639d4de688486, user_id=9ebc987ba1e14f39a9319ac8475bd61d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:42.653606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:42.675764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1146/2321] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:42 2022] PUT /identity/v3/projects/0d8aea888e1d4032904639d4de688486/users/9ebc987ba1e14f39a9319ac8475bd61d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:42.679763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:42.702598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015307-0efb-4f69-9edc-3971ae48bbf6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:42.815487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c77afe-cce0-4b4d-b659-42b29d91f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:42.816137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77afe-cce0-4b4d-b659-42b29d91f94d admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:42.816478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77afe-cce0-4b4d-b659-42b29d91f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:42.816745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c77afe-cce0-4b4d-b659-42b29d91f94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:42.817396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c77afe-cce0-4b4d-b659-42b29d91f94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:42.819272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c77afe-cce0-4b4d-b659-42b29d91f94d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:42.846826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1176/2322] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:42.848295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:42.862203 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632096b-bf66-4363-ade7-f126f967adeb admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:42.868217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:42.868913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:42.869180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:42.869447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] PATH_INFO: `/v3/projects/0d8aea888e1d4032904639d4de688486/users/9ebc987ba1e14f39a9319ac8475bd61d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:42.871497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8aea888e1d4032904639d4de688486, user_id=9ebc987ba1e14f39a9319ac8475bd61d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:42.874207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:42.886696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1147/2323] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:42 2022] PUT /identity/v3/projects/0d8aea888e1d4032904639d4de688486/users/9ebc987ba1e14f39a9319ac8475bd61d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:42.959074 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b45a-2e42-4f96-9e97-dae8c3746fd1 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:42.959354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b45a-2e42-4f96-9e97-dae8c3746fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:42.959623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b45a-2e42-4f96-9e97-dae8c3746fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:42.991417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5c83b45a-2e42-4f96-9e97-dae8c3746fd1 None None] MFA Rules not processed for user `9ebc987ba1e14f39a9319ac8475bd61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:42.992855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5c83b45a-2e42-4f96-9e97-dae8c3746fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:43.072474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1177/2324] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:43.085169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:43.089106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:43.153512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:43.181703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66a31d-7e19-4f90-b2e0-6de50d934e3e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:43.188598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:43.189601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:43.190027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:43.190431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:43.203048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:43.204524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:43.214777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1148/2325] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:43.313127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83b45a-2e42-4f96-9e97-dae8c3746fd1 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:43.324162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83b45a-2e42-4f96-9e97-dae8c3746fd1 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:43.328412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71479-8814-4ce1-b063-aeeba60b68e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:43.329283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71479-8814-4ce1-b063-aeeba60b68e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:43.329783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71479-8814-4ce1-b063-aeeba60b68e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:43.330263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71479-8814-4ce1-b063-aeeba60b68e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:43.373756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:43.392885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71479-8814-4ce1-b063-aeeba60b68e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:43.394333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71479-8814-4ce1-b063-aeeba60b68e2 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:43.403502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1178/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:43.724717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:43.838994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d9321-f5d7-4443-be84-3d3232d55739 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:43.846213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:43.846887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:43.847167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:43.847435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] PATH_INFO: `/v3/users/9204194252d94d4bb4dfe2cc44c65841` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:43.848713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9204194252d94d4bb4dfe2cc44c65841)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:43.850814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:43.927128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9204194252d94d4bb4dfe2cc44c65841'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:43.938677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9204194252d94d4bb4dfe2cc44c65841'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:43.939565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9204194252d94d4bb4dfe2cc44c65841'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:43.940200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9204194252d94d4bb4dfe2cc44c65841'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:43.958227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9204194252d94d4bb4dfe2cc44c65841'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:43.997607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1149/2327] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:43 2022] DELETE /identity/v3/users/9204194252d94d4bb4dfe2cc44c65841 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:44.002141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805909-0054-4950-b842-e954f62efa92 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:44.002428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805909-0054-4950-b842-e954f62efa92 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:44.002696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f805909-0054-4950-b842-e954f62efa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:44.030997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6f805909-0054-4950-b842-e954f62efa92 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:44.030997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6f805909-0054-4950-b842-e954f62efa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:44.094694 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1179/2328] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:44.106485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:44.108536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:44.189253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01700c8-7b72-4ad4-93a8-e1d183eb441d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:44.193669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:44.194285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:44.194552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:44.194816 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:44.206081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:44.207585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:44.214401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:44.237743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1150/2329] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:44.834031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805909-0054-4950-b842-e954f62efa92 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:44.836507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6f805909-0054-4950-b842-e954f62efa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:44.859245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f805909-0054-4950-b842-e954f62efa92 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:44.877170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:44.877839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:44.878113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:44.878383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] PATH_INFO: `/v3/projects/529d5e3ba15c405582dad2fbf5bfeaa7` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:44.880568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=529d5e3ba15c405582dad2fbf5bfeaa7)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:44.883315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:45.021726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529d5e3ba15c405582dad2fbf5bfeaa7', 'request_id': 'req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.048238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529d5e3ba15c405582dad2fbf5bfeaa7', 'request_id': 'req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.066064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529d5e3ba15c405582dad2fbf5bfeaa7', 'request_id': 'req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.087088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] The token cache is being invalidate because project 529d5e3ba15c405582dad2fbf5bfeaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:45.087455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.088287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.096030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1180/2330] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:44 2022] DELETE /identity/v3/projects/529d5e3ba15c405582dad2fbf5bfeaa7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:45.100080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:45.127561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c3ee-d3cb-4a93-a70c-cc79ed2cb7ee service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:45.255871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:45.256515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:45.256793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:45.257055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] PATH_INFO: `/v3/users/9ebc987ba1e14f39a9319ac8475bd61d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:45.258230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebc987ba1e14f39a9319ac8475bd61d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:45.260407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:45.320252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebc987ba1e14f39a9319ac8475bd61d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.331043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebc987ba1e14f39a9319ac8475bd61d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.336252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebc987ba1e14f39a9319ac8475bd61d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.337012 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebc987ba1e14f39a9319ac8475bd61d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.347382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34127cbb-0c5a-4d19-a8ed-69f72b3cd267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebc987ba1e14f39a9319ac8475bd61d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.378998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1151/2331] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:45 2022] DELETE /identity/v3/users/9ebc987ba1e14f39a9319ac8475bd61d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:45.690721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:45.692639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:45.706614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b9ee-631e-44a4-ae2c-cd6bdc354233 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:45.787862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:45.788560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:45.788866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:45.789119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] PATH_INFO: `/v3/projects/0d8aea888e1d4032904639d4de688486` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:45.790289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8aea888e1d4032904639d4de688486)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:45.793055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:45.796310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:45.857909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8aea888e1d4032904639d4de688486', 'request_id': 'req-e0019c5f-728d-42b7-9924-02cccb3bea58'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.889270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8aea888e1d4032904639d4de688486', 'request_id': 'req-e0019c5f-728d-42b7-9924-02cccb3bea58'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.898018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8aea888e1d4032904639d4de688486', 'request_id': 'req-e0019c5f-728d-42b7-9924-02cccb3bea58'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.927315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] The token cache is being invalidate because project 0d8aea888e1d4032904639d4de688486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:45.927903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.928978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0019c5f-728d-42b7-9924-02cccb3bea58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:45.939887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1181/2332] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:45 2022] DELETE /identity/v3/projects/0d8aea888e1d4032904639d4de688486 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:45.942343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0731b-cb5b-47e3-9505-81443d653856 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:45.942626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0731b-cb5b-47e3-9505-81443d653856 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:45.942957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0731b-cb5b-47e3-9505-81443d653856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:45.987234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5dc0731b-cb5b-47e3-9505-81443d653856 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:45.988770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5dc0731b-cb5b-47e3-9505-81443d653856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:46.085750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1152/2333] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:46.095018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d799e43-2c26-44a1-94a7-67dc2f41f0f6 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.095284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d799e43-2c26-44a1-94a7-67dc2f41f0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.095511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d799e43-2c26-44a1-94a7-67dc2f41f0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.154919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0d799e43-2c26-44a1-94a7-67dc2f41f0f6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:46.159202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0d799e43-2c26-44a1-94a7-67dc2f41f0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:46.185830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1182/2334] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:46.190005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0731b-cb5b-47e3-9505-81443d653856 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:46.206672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0731b-cb5b-47e3-9505-81443d653856 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:46.224800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:46.225597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.225717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.225976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.226854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:46.226958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:46.228592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:46.248553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1153/2335] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:00:46.249417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d799e43-2c26-44a1-94a7-67dc2f41f0f6 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:46.265946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d799e43-2c26-44a1-94a7-67dc2f41f0f6 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:46.277436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:46.278835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.279120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.279377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.280994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:46.283792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:46.339771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1183/2336] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:46 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:46.340249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:46.365815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7147-c387-4970-9d61-d3c4647f6cca admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:46.372748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:46.469302 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:46.470054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.470497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.470769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.471402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:46.473342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:46.528895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1154/2337] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:46 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:46.530470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:46.546250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95493202-9ca1-4001-8ad2-98ffd5f4908d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:46.553746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:46.554381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.554659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.554921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.555580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:46.562405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:46.596204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1184/2338] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:46.600470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:46.615895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3d3f-6919-4452-8f04-f9be24039f09 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:46.627387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac32d5-206c-4ca3-8c63-0fe4f865f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:46.628470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac32d5-206c-4ca3-8c63-0fe4f865f2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.628589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac32d5-206c-4ca3-8c63-0fe4f865f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.628771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac32d5-206c-4ca3-8c63-0fe4f865f2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.629470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac32d5-206c-4ca3-8c63-0fe4f865f2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:46.641667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac32d5-206c-4ca3-8c63-0fe4f865f2b1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:46.665993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1155/2339] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:46.667462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:46.680570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae01248-bd4f-46df-b2ec-1d775f48e51d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:46.686752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:46.687447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.687791 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.688320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] PATH_INFO: `/v3/projects/dabf00e083cb4963b643506e46e09ed3/users/b72a57eb0ad14a0a9b5c33601bf7e8b0/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.714361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabf00e083cb4963b643506e46e09ed3, user_id=b72a57eb0ad14a0a9b5c33601bf7e8b0, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:46.714361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:46.747392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1185/2340] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:46 2022] PUT /identity/v3/projects/dabf00e083cb4963b643506e46e09ed3/users/b72a57eb0ad14a0a9b5c33601bf7e8b0/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:46.750845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0c25-c7c6-4016-ae90-3754fe03f986 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:46.751986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0c25-c7c6-4016-ae90-3754fe03f986 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:46.752454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0c25-c7c6-4016-ae90-3754fe03f986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:46.794646 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-33bf0c25-c7c6-4016-ae90-3754fe03f986 None None] MFA Rules not processed for user `b72a57eb0ad14a0a9b5c33601bf7e8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:46.796566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-33bf0c25-c7c6-4016-ae90-3754fe03f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:46.895725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1156/2341] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:46.903269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:46.906770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:47.012570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13bf51-0599-4c3d-9b7e-955f2751de3a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:47.022778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c889b9-f0ab-4b74-905a-53acef23c4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:47.024481 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c889b9-f0ab-4b74-905a-53acef23c4cb service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:47.024753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c889b9-f0ab-4b74-905a-53acef23c4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:47.025644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c889b9-f0ab-4b74-905a-53acef23c4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:47.041756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c889b9-f0ab-4b74-905a-53acef23c4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:47.044068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c889b9-f0ab-4b74-905a-53acef23c4cb service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:47.088148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1186/2342] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:50.714026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf0c25-c7c6-4016-ae90-3754fe03f986 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:50.902744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf0c25-c7c6-4016-ae90-3754fe03f986 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:50.908694 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:50.909419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:50.909699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:50.909968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] PATH_INFO: `/v3/users/b72a57eb0ad14a0a9b5c33601bf7e8b0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:50.911140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72a57eb0ad14a0a9b5c33601bf7e8b0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:50.913233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:50.935647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:50.998891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72a57eb0ad14a0a9b5c33601bf7e8b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.007932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72a57eb0ad14a0a9b5c33601bf7e8b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.008622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72a57eb0ad14a0a9b5c33601bf7e8b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.009357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72a57eb0ad14a0a9b5c33601bf7e8b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.017863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72a57eb0ad14a0a9b5c33601bf7e8b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.037681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1157/2343] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:50 2022] DELETE /identity/v3/users/b72a57eb0ad14a0a9b5c33601bf7e8b0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:51.043306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:51.044036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:51.044135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:51.067610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:51.068938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:51.110612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:51.150483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1187/2344] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:51.161512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:51.163140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:51.233800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bda37-8ef0-4b9f-ac19-c18a00b9e03c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:51.238047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:51.238883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:51.239144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:51.239548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:51.250160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:51.251776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:51.262876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1158/2345] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:51.695908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:51.695908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:51.704845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cc2a9-bbcf-43e5-a934-286cdf9d33c3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:51.712271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:51.712925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:51.713209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:51.713477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] PATH_INFO: `/v3/projects/dabf00e083cb4963b643506e46e09ed3` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:51.714642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabf00e083cb4963b643506e46e09ed3)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:51.716839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:51.780799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabf00e083cb4963b643506e46e09ed3', 'request_id': 'req-aba3d10a-15a1-4322-b6de-66b68d63ed69'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.790748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabf00e083cb4963b643506e46e09ed3', 'request_id': 'req-aba3d10a-15a1-4322-b6de-66b68d63ed69'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.803817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabf00e083cb4963b643506e46e09ed3', 'request_id': 'req-aba3d10a-15a1-4322-b6de-66b68d63ed69'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.823794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] The token cache is being invalidate because project dabf00e083cb4963b643506e46e09ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:51.824138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.824940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-aba3d10a-15a1-4322-b6de-66b68d63ed69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:51.826597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1188/2346] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:51 2022] DELETE /identity/v3/projects/dabf00e083cb4963b643506e46e09ed3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:51.845183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:51.847535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:51.874154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369f7ac-61b0-4681-947a-a20a9d28df18 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:52.014955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:52.015641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.015935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.016364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] PATH_INFO: `/v3/users/fa9bd7fb2c2642cdbb1ec24fc9821346` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.017625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9bd7fb2c2642cdbb1ec24fc9821346)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:52.019640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:52.109656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:52.120874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9bd7fb2c2642cdbb1ec24fc9821346'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.137645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9bd7fb2c2642cdbb1ec24fc9821346'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.138853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9bd7fb2c2642cdbb1ec24fc9821346'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.139031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9bd7fb2c2642cdbb1ec24fc9821346'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.154617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9bd7fb2c2642cdbb1ec24fc9821346'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.175193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1159/2347] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:51 2022] DELETE /identity/v3/users/fa9bd7fb2c2642cdbb1ec24fc9821346 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:52.179901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.180497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.180595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.206320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:52.207459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:52.299194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1189/2348] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:52.306420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:52.308490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:52.372779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2a8c-36bf-4a9f-a493-8689dca72c48 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:52.376355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6f9d7-4f1c-4bc5-bf49-0e74481c4ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:52.376963 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6f9d7-4f1c-4bc5-bf49-0e74481c4ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.377236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6f9d7-4f1c-4bc5-bf49-0e74481c4ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.377500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6f9d7-4f1c-4bc5-bf49-0e74481c4ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.386346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6f9d7-4f1c-4bc5-bf49-0e74481c4ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:52.388470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6f9d7-4f1c-4bc5-bf49-0e74481c4ab0 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:52.397867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1160/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:52.679640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:52.681097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:52.693586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92100642-1e9e-4ad1-9b57-3b694876e5df None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:52.698672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:52.699916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.699916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.700196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] PATH_INFO: `/v3/projects/5b3dc01456f94c738fcd35c5f5aff786` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.701758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3dc01456f94c738fcd35c5f5aff786)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:52.703811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:52.767429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3dc01456f94c738fcd35c5f5aff786', 'request_id': 'req-298ca103-826f-4fe6-96ac-2d1040bc499e'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.769082 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:52.783286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3dc01456f94c738fcd35c5f5aff786', 'request_id': 'req-298ca103-826f-4fe6-96ac-2d1040bc499e'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.790589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3dc01456f94c738fcd35c5f5aff786', 'request_id': 'req-298ca103-826f-4fe6-96ac-2d1040bc499e'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.802746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] The token cache is being invalidate because project 5b3dc01456f94c738fcd35c5f5aff786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:52.803030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.803708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-298ca103-826f-4fe6-96ac-2d1040bc499e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:52.805244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1190/2350] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:52 2022] DELETE /identity/v3/projects/5b3dc01456f94c738fcd35c5f5aff786 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:52.810322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3888-2ce3-409f-87f2-db6cfd682e25 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.810607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3888-2ce3-409f-87f2-db6cfd682e25 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.810876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3888-2ce3-409f-87f2-db6cfd682e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.830781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-056a3888-2ce3-409f-87f2-db6cfd682e25 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:52.832024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-056a3888-2ce3-409f-87f2-db6cfd682e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:52.901086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1161/2351] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:52.910165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738e9a9-fe58-4495-a699-d3e14d5f1715 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.910471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738e9a9-fe58-4495-a699-d3e14d5f1715 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.910761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738e9a9-fe58-4495-a699-d3e14d5f1715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.930593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6738e9a9-fe58-4495-a699-d3e14d5f1715 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:52.931816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6738e9a9-fe58-4495-a699-d3e14d5f1715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:52.940250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1191/2352] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:52.944491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3888-2ce3-409f-87f2-db6cfd682e25 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:52.954429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3888-2ce3-409f-87f2-db6cfd682e25 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:52.959830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:52.960426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.960697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.960945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.961583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:52.961881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:52.963475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:52.975282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1162/2353] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:52.979649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738e9a9-fe58-4495-a699-d3e14d5f1715 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:52.989830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738e9a9-fe58-4495-a699-d3e14d5f1715 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:52.995441 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:52.996296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:52.996567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:52.996829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:52.997659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:52.999964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:53.030879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1192/2354] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:52 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:53.036804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:53.047595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0ab4b-c663-486c-99af-010b05e271d7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:53.094193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:53.110211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:53.110910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.111259 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.111586 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.112386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:53.114437 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:53.146047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1163/2355] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:53 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:53.147447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:53.158099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5274927-8203-46e5-ac78-7e0826947094 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:53.162654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:53.163261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.163537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.163831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.164564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:53.166078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:53.192462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1193/2356] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:53.196683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:53.207653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641fc38-20d8-4882-814e-bb3ef480c439 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:53.212069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b7dc3-e39d-4c64-962a-12dee88df618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:53.212689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b7dc3-e39d-4c64-962a-12dee88df618 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.212950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b7dc3-e39d-4c64-962a-12dee88df618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.213217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b7dc3-e39d-4c64-962a-12dee88df618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.213856 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b7dc3-e39d-4c64-962a-12dee88df618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:53.216217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b7dc3-e39d-4c64-962a-12dee88df618 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:53.227885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1164/2357] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:00:53.232125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:53.243385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d433-6829-4e60-aca0-415098c3c963 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:53.254193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:53.255016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.255365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.255692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] PATH_INFO: `/v3/projects/360fa239d4da44d694101e0b581df933/users/c697dccc0d14437198c63643c276cf6c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.271602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=360fa239d4da44d694101e0b581df933, user_id=c697dccc0d14437198c63643c276cf6c, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:53.274751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:53.288418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1194/2358] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:53 2022] PUT /identity/v3/projects/360fa239d4da44d694101e0b581df933/users/c697dccc0d14437198c63643c276cf6c/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:53.299419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89cf2-56bf-49de-b3b3-8f7708cd65f9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.299726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89cf2-56bf-49de-b3b3-8f7708cd65f9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.299985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c89cf2-56bf-49de-b3b3-8f7708cd65f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.328635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-51c89cf2-56bf-49de-b3b3-8f7708cd65f9 None None] MFA Rules not processed for user `c697dccc0d14437198c63643c276cf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:53.329873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-51c89cf2-56bf-49de-b3b3-8f7708cd65f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:53.422852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1165/2359] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:53.436626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:53.438706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:53.466116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.466705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.467130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.493112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:53.494464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:53.516002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894ada-17bb-4f39-a3af-c56febf6a5a2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:53.520240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:53.520897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.521171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.521437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.532654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:53.534141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:53.544394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1195/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:00:53.580979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1166/2361] 10.222.0.42 () {58 vars in 967 bytes} [Thu Sep 15 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:53.595933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:53.597587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:53.685464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0fc8-ad12-4590-9c60-32b376c785be service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:53.690948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082353a-6559-4b28-b698-8c2ef9c15821 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:53.691690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082353a-6559-4b28-b698-8c2ef9c15821 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:53.691995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082353a-6559-4b28-b698-8c2ef9c15821 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:53.692261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082353a-6559-4b28-b698-8c2ef9c15821 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:53.700557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082353a-6559-4b28-b698-8c2ef9c15821 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:53.702149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082353a-6559-4b28-b698-8c2ef9c15821 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:53.710358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1196/2362] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:00:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:00:56.263823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:56.265311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:56.336314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b890592-8d13-4a70-9b12-c8938b4b9d0d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:56.340881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:56.341515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:56.341783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:56.342046 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] PATH_INFO: `/v3/users/adff6418c8d54bb9913a5d26b7fa09c0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:56.343517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adff6418c8d54bb9913a5d26b7fa09c0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:56.345476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:56.347090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:56.410257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adff6418c8d54bb9913a5d26b7fa09c0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.420535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adff6418c8d54bb9913a5d26b7fa09c0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.421148 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adff6418c8d54bb9913a5d26b7fa09c0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.421790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adff6418c8d54bb9913a5d26b7fa09c0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.434194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adff6418c8d54bb9913a5d26b7fa09c0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.462609 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1167/2363] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:00:56 2022] DELETE /identity/v3/users/adff6418c8d54bb9913a5d26b7fa09c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:56.560855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbab70-9399-4a30-9b82-14163697fb81 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:56.561845 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbab70-9399-4a30-9b82-14163697fb81 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:56.562611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbab70-9399-4a30-9b82-14163697fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:56.577540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:56.585592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-90cbab70-9399-4a30-9b82-14163697fb81 None None] MFA Rules not processed for user `cb0d882b2ac745399a6d1e524c464676`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:56.588264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-90cbab70-9399-4a30-9b82-14163697fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:56.670220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1197/2364] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:56.707967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:56.709606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:56.818842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44223c3f-191c-4e5d-926d-2cb9adde3e63 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:56.840401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:56.841455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:56.841714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:56.842779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] PATH_INFO: `/v3/projects/c90f76e22c394fb18941e7c422f4f830` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:56.844539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90f76e22c394fb18941e7c422f4f830)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:56.846765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:56.915125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90f76e22c394fb18941e7c422f4f830', 'request_id': 'req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.925840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90f76e22c394fb18941e7c422f4f830', 'request_id': 'req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.933595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90f76e22c394fb18941e7c422f4f830', 'request_id': 'req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.946682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] The token cache is being invalidate because project c90f76e22c394fb18941e7c422f4f830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:00:56.947103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.948085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-df5fb43c-3fdd-4403-8072-ffb3e4d965aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:00:56.949925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1168/2365] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:00:56 2022] DELETE /identity/v3/projects/c90f76e22c394fb18941e7c422f4f830 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:00:56.954706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299ce4-e761-474d-a15f-8c7d9414fe23 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:56.954994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299ce4-e761-474d-a15f-8c7d9414fe23 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:56.955264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc299ce4-e761-474d-a15f-8c7d9414fe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:56.979105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-bc299ce4-e761-474d-a15f-8c7d9414fe23 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:56.981005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bc299ce4-e761-474d-a15f-8c7d9414fe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:57.052283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1198/2366] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:57.060066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80153517-aef7-4f36-a424-b06bf0f674da None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.060340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80153517-aef7-4f36-a424-b06bf0f674da None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.060624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80153517-aef7-4f36-a424-b06bf0f674da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.080923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-80153517-aef7-4f36-a424-b06bf0f674da None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:57.082116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-80153517-aef7-4f36-a424-b06bf0f674da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:57.090534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1169/2367] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:00:57.096069 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299ce4-e761-474d-a15f-8c7d9414fe23 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:57.105806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc299ce4-e761-474d-a15f-8c7d9414fe23 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:57.110508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:57.111142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.111416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.111680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.112342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:00:57.112642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:57.114244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:57.126398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1199/2368] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:00:57.130818 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80153517-aef7-4f36-a424-b06bf0f674da None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:57.135200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:57.141618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80153517-aef7-4f36-a424-b06bf0f674da None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:57.147655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:57.148522 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.148941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.149272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.150159 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:57.152178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:57.182794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1170/2369] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:00:57 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:00:57.188760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:57.200445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eccf55-101d-4992-a62b-420c79901795 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:57.263959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:57.264611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.264888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.265148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.266606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:57.268723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:57.294221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1200/2370] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:00:57 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:00:57.310913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:57.321779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d99a1-65bc-487b-99c8-bf8b91f57598 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:57.326684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:57.327291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.327571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.327868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.328535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:57.330141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:57.340123 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1171/2371] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:57.344652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:57.354904 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7a5d2-ffad-41e1-a3a5-1fa8073fa670 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:57.360356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c5555-fba2-4f0e-806d-c6f5b941b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:57.360961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5555-fba2-4f0e-806d-c6f5b941b931 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.361256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5555-fba2-4f0e-806d-c6f5b941b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.361508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c5555-fba2-4f0e-806d-c6f5b941b931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.362139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5555-fba2-4f0e-806d-c6f5b941b931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:57.363770 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c5555-fba2-4f0e-806d-c6f5b941b931 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:57.375232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1201/2372] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:00:57.379724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:57.391288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8d28c-a186-4589-920e-6fb9314aeba2 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:57.397275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:57.397951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.398226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.398494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] PATH_INFO: `/v3/projects/0c746f9ab22f401b806ddcd824b3a455/users/9d977a70ed024dee93670c0e3fbde9e7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.421980 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c746f9ab22f401b806ddcd824b3a455, user_id=9d977a70ed024dee93670c0e3fbde9e7, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:57.425571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:57.451073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1172/2373] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:00:57 2022] PUT /identity/v3/projects/0c746f9ab22f401b806ddcd824b3a455/users/9d977a70ed024dee93670c0e3fbde9e7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:00:57.461612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2315a-80c9-4f92-8028-cd3524af9b7e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.461899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2315a-80c9-4f92-8028-cd3524af9b7e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.462170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2315a-80c9-4f92-8028-cd3524af9b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.491923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f0a2315a-80c9-4f92-8028-cd3524af9b7e None None] MFA Rules not processed for user `9d977a70ed024dee93670c0e3fbde9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:57.493138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f0a2315a-80c9-4f92-8028-cd3524af9b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:57.498743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:00:57.563582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1202/2374] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:00:57.574977 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:00:57.576675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:57.640003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240667f-6139-44c0-82b7-64d41c9f7285 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:00:57.645635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:00:57.646405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:57.646784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:57.647108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:57.657800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:00:57.659423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:00:57.670494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1173/2375] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:00:59.123610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3ec7-c9f0-4719-ad3c-b1117903afde None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:00:59.124202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3ec7-c9f0-4719-ad3c-b1117903afde None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:00:59.124202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f3ec7-c9f0-4719-ad3c-b1117903afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:00:59.146935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6e7f3ec7-c9f0-4719-ad3c-b1117903afde None None] MFA Rules not processed for user `9d977a70ed024dee93670c0e3fbde9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:00:59.148171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6e7f3ec7-c9f0-4719-ad3c-b1117903afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:00:59.155323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1203/2376] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:00:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:04.661638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:04.663248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:04.730929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d7f7c-e2f5-4e5b-8352-4462640f0c1a service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:04.735579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:04.736538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:04.736884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:04.737225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] PATH_INFO: `/v3/users/c697dccc0d14437198c63643c276cf6c` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:04.738417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c697dccc0d14437198c63643c276cf6c)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:04.740501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:04.793478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c697dccc0d14437198c63643c276cf6c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:04.796211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:04.802517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c697dccc0d14437198c63643c276cf6c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:04.802915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c697dccc0d14437198c63643c276cf6c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:04.804233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c697dccc0d14437198c63643c276cf6c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:04.815076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c697dccc0d14437198c63643c276cf6c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:04.842755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1174/2377] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:01:04 2022] DELETE /identity/v3/users/c697dccc0d14437198c63643c276cf6c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:01:04.854136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:04.854972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:04.854972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:04.878007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:04.879277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:04.951836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1204/2378] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:01:04.961707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:04.963153 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:05.028554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd484d-7b9d-415f-b852-7d69b23350e9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:05.032244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736870c-ebce-4b0f-936c-b8b4372c612f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:05.032941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736870c-ebce-4b0f-936c-b8b4372c612f service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:05.033278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736870c-ebce-4b0f-936c-b8b4372c612f service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:05.033614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736870c-ebce-4b0f-936c-b8b4372c612f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:05.043611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736870c-ebce-4b0f-936c-b8b4372c612f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:05.045088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736870c-ebce-4b0f-936c-b8b4372c612f service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:05.054768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1175/2379] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:05.346683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:05.348230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:05.361987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3fad8-b87f-4671-8916-278787cd170d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:05.366738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:05.367389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:05.367672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:05.367969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] PATH_INFO: `/v3/projects/360fa239d4da44d694101e0b581df933` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:05.369103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] RBAC: Authorizing `identity:delete_project(project_id=360fa239d4da44d694101e0b581df933)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:05.371099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:05.422222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360fa239d4da44d694101e0b581df933', 'request_id': 'req-ee5035df-7b69-4af1-b039-e2c16d21425c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:05.437350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360fa239d4da44d694101e0b581df933', 'request_id': 'req-ee5035df-7b69-4af1-b039-e2c16d21425c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:05.443745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360fa239d4da44d694101e0b581df933', 'request_id': 'req-ee5035df-7b69-4af1-b039-e2c16d21425c'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:05.455438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] The token cache is being invalidate because project 360fa239d4da44d694101e0b581df933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:01:05.455744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:05.456412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:05.457897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1205/2380] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:01:05 2022] DELETE /identity/v3/projects/360fa239d4da44d694101e0b581df933 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:01:06.315445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d71e2-1a2b-4f84-9012-214a6899971e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:06.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d71e2-1a2b-4f84-9012-214a6899971e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:06.316026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d71e2-1a2b-4f84-9012-214a6899971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:06.338504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-e45d71e2-1a2b-4f84-9012-214a6899971e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:06.339730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e45d71e2-1a2b-4f84-9012-214a6899971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:06.403025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1176/2381] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:06.428099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:06.429623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:06.460644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:06.512306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5035df-7b69-4af1-b039-e2c16d21425c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:06.518266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:06.518887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:06.519158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:06.519557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:06.528677 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:06.530287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:06.541095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1206/2382] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:09.201893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de86ca4-bf48-48ab-91f9-e720ac725201 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:09.202355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de86ca4-bf48-48ab-91f9-e720ac725201 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:09.202554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de86ca4-bf48-48ab-91f9-e720ac725201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:09.224278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8de86ca4-bf48-48ab-91f9-e720ac725201 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:09.225553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8de86ca4-bf48-48ab-91f9-e720ac725201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:09.285735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1177/2383] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:09.298113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:09.299531 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:09.369474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d50df9-7ec5-49a6-8de8-b0936fa84997 service nova] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:09.375446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:09.376094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:09.376343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:09.376614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:09.385507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:09.387885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:09.396132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1207/2384] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:01:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:01:09.550193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290185d-080f-43a7-81ea-db85240944b8 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:09.550486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290185d-080f-43a7-81ea-db85240944b8 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:09.550743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290185d-080f-43a7-81ea-db85240944b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:09.574895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c290185d-080f-43a7-81ea-db85240944b8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:09.576169 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c290185d-080f-43a7-81ea-db85240944b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:09.585290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1178/2385] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:09.617367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:09.619223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:09.646143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909bc2-0592-4e71-9832-b2aa262bc077 service swift] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:09.652994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:09.653625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:09.653901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:09.654172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:09.664002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:09.665608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:09.678132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1208/2386] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:13.866147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c31b-439a-40fa-a536-58822c2253e0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:13.866674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c31b-439a-40fa-a536-58822c2253e0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:13.866674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1c31b-439a-40fa-a536-58822c2253e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:13.919605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-42f1c31b-439a-40fa-a536-58822c2253e0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:13.920967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-42f1c31b-439a-40fa-a536-58822c2253e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:13.940321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1179/2387] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:13.960938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:13.973587 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649256fc-50b0-44f1-8a6a-049973635067 service nova] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:13.980205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:13.980819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:13.981092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:13.981355 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:13.990490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:13.992234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:14.003546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1209/2388] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:19.041232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0092-ff03-48ff-a340-440ca08cbf52 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:19.041892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0092-ff03-48ff-a340-440ca08cbf52 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:19.041892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d0092-ff03-48ff-a340-440ca08cbf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:19.053272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:19.067208 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-068d0092-ff03-48ff-a340-440ca08cbf52 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:19.068570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-068d0092-ff03-48ff-a340-440ca08cbf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:19.077340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1180/2389] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:19.093890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:19.105101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64302-5b56-45e7-83f5-2db9b2df2d90 service nova] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:19.113383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:19.114000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:19.114276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:19.114542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:19.123555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:19.126132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:19.139258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1210/2390] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:22.164024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52a5ba-5eae-4c9c-b7db-41d754dd65f0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:22.164562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52a5ba-5eae-4c9c-b7db-41d754dd65f0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:22.164562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52a5ba-5eae-4c9c-b7db-41d754dd65f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:22.184418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0e52a5ba-5eae-4c9c-b7db-41d754dd65f0 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:22.185637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0e52a5ba-5eae-4c9c-b7db-41d754dd65f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:22.193006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1181/2391] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:22.212066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:22.229139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bc860-bc02-4f6f-ae35-5bcc27b8b729 service nova] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:22.235451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:22.236033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:22.236315 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:22.236586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:22.245092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:22.246672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:22.255102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1211/2392] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:01:22.810928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef394-7a55-40f9-b213-9f39f6b37116 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:22.811213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef394-7a55-40f9-b213-9f39f6b37116 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:22.811478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef394-7a55-40f9-b213-9f39f6b37116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:22.831037 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-94eef394-7a55-40f9-b213-9f39f6b37116 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:22.832268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-94eef394-7a55-40f9-b213-9f39f6b37116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:22.839395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1182/2393] 10.222.0.42 () {58 vars in 967 bytes} [Thu Sep 15 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:22.853638 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:22.864613 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33315-f5c3-4930-8bbc-491bf465ffe8 service swift] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:22.870131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:22.870717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:22.870989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:22.871254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:22.879754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:22.881323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:22.891344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1212/2394] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:01:23.152178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d504e-de7a-4e44-8166-55e0e2108c25 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:23.152465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d504e-de7a-4e44-8166-55e0e2108c25 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:23.153024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d504e-de7a-4e44-8166-55e0e2108c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:23.173374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-463d504e-de7a-4e44-8166-55e0e2108c25 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:23.174651 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-463d504e-de7a-4e44-8166-55e0e2108c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:23.193451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1183/2395] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:23.206223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:23.217470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ca8c-acce-4461-a901-23e8709b9fd0 service swift] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:23.223689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:23.224326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:23.224603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:23.224860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:23.233547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:23.235126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:23.248593 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1213/2396] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:01:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:01:23.293781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a90c-bad9-4286-9ec9-3bb247e3d2ac None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:23.294136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a90c-bad9-4286-9ec9-3bb247e3d2ac None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:23.294706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3a90c-bad9-4286-9ec9-3bb247e3d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:23.316940 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-87e3a90c-bad9-4286-9ec9-3bb247e3d2ac None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:23.318156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-87e3a90c-bad9-4286-9ec9-3bb247e3d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:23.327085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1184/2397] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:23.348245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:23.362370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfda29-8b6c-4856-b200-297e94ab4469 service swift] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:23.368760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:23.369224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:23.369493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:23.369755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:23.379799 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:23.381660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:23.392368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1214/2398] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:23.582196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a832-c25f-4495-bf5c-abe6315a31ce None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:23.582474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a832-c25f-4495-bf5c-abe6315a31ce None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:23.582736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a832-c25f-4495-bf5c-abe6315a31ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:23.604406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8b85a832-c25f-4495-bf5c-abe6315a31ce None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:23.605584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8b85a832-c25f-4495-bf5c-abe6315a31ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:23.613065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1185/2399] 10.222.0.42 () {58 vars in 967 bytes} [Thu Sep 15 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:23.626019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:23.643606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381dfb6-13f7-4281-84c3-625e410c49fc service nova] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:23.653068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed57c4-15e5-4cec-8d86-13abe2065cfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:23.653945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed57c4-15e5-4cec-8d86-13abe2065cfc service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:23.654630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed57c4-15e5-4cec-8d86-13abe2065cfc service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:23.654815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed57c4-15e5-4cec-8d86-13abe2065cfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:23.660234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:23.664247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed57c4-15e5-4cec-8d86-13abe2065cfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:23.666072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed57c4-15e5-4cec-8d86-13abe2065cfc service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:23.674158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1215/2400] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:01:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:01:25.819740 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d994d1-4e89-4cea-8d33-3f0eff1431f9 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:25.820307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d994d1-4e89-4cea-8d33-3f0eff1431f9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:25.820307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d994d1-4e89-4cea-8d33-3f0eff1431f9 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:25.821645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1186/2401] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 13:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 13:01:25.829966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:25.830493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:25.830583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:25.864615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d994d1-4e89-4cea-8d33-3f0eff1431f9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:25.866294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-75d994d1-4e89-4cea-8d33-3f0eff1431f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:25.875653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:25.877191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:25.882062 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d994d1-4e89-4cea-8d33-3f0eff1431f9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:25.886837 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:25.887788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:25.888011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1216/2402] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:25.888434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:25.888796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] PATH_INFO: `/v3/users/9d977a70ed024dee93670c0e3fbde9e7` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:25.890433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d977a70ed024dee93670c0e3fbde9e7)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:25.892499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:25.903977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:25.905653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:25.955826 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d977a70ed024dee93670c0e3fbde9e7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:25.967638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d977a70ed024dee93670c0e3fbde9e7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:25.968547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d977a70ed024dee93670c0e3fbde9e7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:25.969326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d977a70ed024dee93670c0e3fbde9e7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:25.969758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477c14e-5b5f-4b7c-894a-76fdb96638c9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:25.974320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dda3c-3561-41bc-bd08-abf1b1204e85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:25.974952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dda3c-3561-41bc-bd08-abf1b1204e85 service glance] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:25.975230 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dda3c-3561-41bc-bd08-abf1b1204e85 service glance] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:25.975545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dda3c-3561-41bc-bd08-abf1b1204e85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:25.977553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0d6dda3c-3561-41bc-bd08-abf1b1204e85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:25.977685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d6d30115-4eed-4cea-9d35-feb92e20b07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d977a70ed024dee93670c0e3fbde9e7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:25.991746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dda3c-3561-41bc-bd08-abf1b1204e85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:25.993189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dda3c-3561-41bc-bd08-abf1b1204e85 service glance] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.001794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1187/2403] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:01:25 2022] DELETE /identity/v3/users/9d977a70ed024dee93670c0e3fbde9e7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:01:26.003359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.003845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.004213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.004750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1217/2404] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:01:26.023766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:26.024991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.083641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489793-7248-4f05-b02e-b453cbf506e5 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.083990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489793-7248-4f05-b02e-b453cbf506e5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.084273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489793-7248-4f05-b02e-b453cbf506e5 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.085659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1218/2405] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 13:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 13:01:26.090275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3959a-d092-464d-bec2-050d32628a93 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.090557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3959a-d092-464d-bec2-050d32628a93 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.090825 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3959a-d092-464d-bec2-050d32628a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.095736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1188/2406] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:26.102625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.104248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.111368 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-efe3959a-d092-464d-bec2-050d32628a93 None None] MFA Rules not processed for user `3a022b80e5eb460b92e4e99728b22770`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:26.112542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-efe3959a-d092-464d-bec2-050d32628a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.145434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:26.164270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5521b7-6f95-4d24-906e-8930392c8fd2 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.167906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae34b4e-a38d-4fd0-9436-a69e59e19415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.168519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae34b4e-a38d-4fd0-9436-a69e59e19415 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.168795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae34b4e-a38d-4fd0-9436-a69e59e19415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.169059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae34b4e-a38d-4fd0-9436-a69e59e19415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.172709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1219/2407] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:01:26.178541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae34b4e-a38d-4fd0-9436-a69e59e19415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.180018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae34b4e-a38d-4fd0-9436-a69e59e19415 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.185091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3959a-d092-464d-bec2-050d32628a93 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.191468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1189/2408] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:01:26.194712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe3959a-d092-464d-bec2-050d32628a93 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.198478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4d17d-a878-4d15-8e02-c76b7e609b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.199143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d17d-a878-4d15-8e02-c76b7e609b16 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.199443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d17d-a878-4d15-8e02-c76b7e609b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.199722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4d17d-a878-4d15-8e02-c76b7e609b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.207563 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d17d-a878-4d15-8e02-c76b7e609b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.209042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4d17d-a878-4d15-8e02-c76b7e609b16 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.217480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1220/2409] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:26.344295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d59b-bec7-444a-b8ad-8cfe5ee991be None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.344863 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d59b-bec7-444a-b8ad-8cfe5ee991be None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.345540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108d59b-bec7-444a-b8ad-8cfe5ee991be None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.347817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1190/2410] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 13:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 13:01:26.352973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b69e8-1cdf-4a83-9c36-53a6b4d067f5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.353262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b69e8-1cdf-4a83-9c36-53a6b4d067f5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.353779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b69e8-1cdf-4a83-9c36-53a6b4d067f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.375921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-239b69e8-1cdf-4a83-9c36-53a6b4d067f5 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:26.377223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-239b69e8-1cdf-4a83-9c36-53a6b4d067f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.435661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108d59b-bec7-444a-b8ad-8cfe5ee991be None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.437879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f108d59b-bec7-444a-b8ad-8cfe5ee991be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.458493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108d59b-bec7-444a-b8ad-8cfe5ee991be None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.463200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.464030 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.464308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.464579 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] PATH_INFO: `/v3/projects/0c746f9ab22f401b806ddcd824b3a455` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.465760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c746f9ab22f401b806ddcd824b3a455)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.468263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.479923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1221/2411] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:26.481982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.482403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.482773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.503392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:26.504683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.513489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1222/2412] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:26.514403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.516006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.521615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c746f9ab22f401b806ddcd824b3a455', 'request_id': 'req-aef4901a-27a3-490f-b18c-c18d43e029e3'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:26.527804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e10ca3-3121-4590-bb91-d3ccec29db3d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.531588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c746f9ab22f401b806ddcd824b3a455', 'request_id': 'req-aef4901a-27a3-490f-b18c-c18d43e029e3'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:26.536427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:26.538715 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c746f9ab22f401b806ddcd824b3a455', 'request_id': 'req-aef4901a-27a3-490f-b18c-c18d43e029e3'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:26.551843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] The token cache is being invalidate because project 0c746f9ab22f401b806ddcd824b3a455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:01:26.552149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:26.552822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:26.554340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1191/2413] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:01:26 2022] DELETE /identity/v3/projects/0c746f9ab22f401b806ddcd824b3a455 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:01:26.555085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.556417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.581909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaf198-ecbc-492c-93fd-ebdb79239589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.582528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaf198-ecbc-492c-93fd-ebdb79239589 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.582815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaf198-ecbc-492c-93fd-ebdb79239589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.583076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaf198-ecbc-492c-93fd-ebdb79239589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.584887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8caaf198-ecbc-492c-93fd-ebdb79239589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.631262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4901a-27a3-490f-b18c-c18d43e029e3 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.636847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6321122-f126-403a-972d-17739a92b68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.637569 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6321122-f126-403a-972d-17739a92b68f service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.637851 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6321122-f126-403a-972d-17739a92b68f service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.638232 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6321122-f126-403a-972d-17739a92b68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.640591 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c6321122-f126-403a-972d-17739a92b68f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.657909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaf198-ecbc-492c-93fd-ebdb79239589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.659500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaf198-ecbc-492c-93fd-ebdb79239589 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.670263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1223/2414] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:26.671542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda39134-a79b-42af-a9cd-e6eda76ef1f9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.671900 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda39134-a79b-42af-a9cd-e6eda76ef1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.672167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda39134-a79b-42af-a9cd-e6eda76ef1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.692079 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-eda39134-a79b-42af-a9cd-e6eda76ef1f9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:26.693335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-eda39134-a79b-42af-a9cd-e6eda76ef1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.706070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:26.709924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6321122-f126-403a-972d-17739a92b68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.712112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6321122-f126-403a-972d-17739a92b68f service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.725477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1192/2415] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:26.763378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1224/2416] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:26.771415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435e440-24b4-4722-8808-c0ff00d55239 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.771711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435e440-24b4-4722-8808-c0ff00d55239 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.771991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435e440-24b4-4722-8808-c0ff00d55239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.793564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9435e440-24b4-4722-8808-c0ff00d55239 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:26.794777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9435e440-24b4-4722-8808-c0ff00d55239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:26.803758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1193/2417] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:26.807923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda39134-a79b-42af-a9cd-e6eda76ef1f9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.819160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda39134-a79b-42af-a9cd-e6eda76ef1f9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.824263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.824970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.825346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.825690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.826411 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:01:26.826772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.829831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.842961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1225/2418] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:01:26.847630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435e440-24b4-4722-8808-c0ff00d55239 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.857480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435e440-24b4-4722-8808-c0ff00d55239 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.862170 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.862775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.863048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.863316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.864003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.865883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:26.898668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1194/2419] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:01:26.900342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:26.910853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1231d8-2d1f-4114-a1fc-c3be9a5ed652 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:26.951390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:26.981086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:26.981086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:26.981086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:26.981086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:26.981789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:26.983202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:27.006366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1226/2420] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:01:26 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:01:27.010685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:27.021150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19621-6cd4-49ba-9366-54d7ca48c334 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:27.025897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:27.026696 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:27.027029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:27.027363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:27.028215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:27.029997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:27.040675 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1195/2421] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:01:27.045232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:27.060542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b309824-ae8f-4c94-960d-7be1c3cdbd23 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:27.066080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb461d20-8bb3-4207-9599-2e09480a90e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:27.066704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461d20-8bb3-4207-9599-2e09480a90e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:27.066983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461d20-8bb3-4207-9599-2e09480a90e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:27.067377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461d20-8bb3-4207-9599-2e09480a90e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:27.068075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb461d20-8bb3-4207-9599-2e09480a90e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:27.069787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb461d20-8bb3-4207-9599-2e09480a90e3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:27.082556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1227/2422] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:01:27.086755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:27.097421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16525-e7a4-467b-aeb2-76fd4c4fd5b2 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:27.102229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:27.102895 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:27.103160 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:27.103430 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] PATH_INFO: `/v3/projects/282bd50425164607974fdfc19762f9c7/users/ed74e65565af4b65a3daf1a75084c2ed/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:27.118990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282bd50425164607974fdfc19762f9c7, user_id=ed74e65565af4b65a3daf1a75084c2ed, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:27.121360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:27.136260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1196/2423] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:01:27 2022] PUT /identity/v3/projects/282bd50425164607974fdfc19762f9c7/users/ed74e65565af4b65a3daf1a75084c2ed/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:01:27.206847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12811-8f95-4848-9b6d-b8deb170c6fe None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:27.207138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12811-8f95-4848-9b6d-b8deb170c6fe None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:27.207427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d12811-8f95-4848-9b6d-b8deb170c6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:27.236203 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-04d12811-8f95-4848-9b6d-b8deb170c6fe None None] MFA Rules not processed for user `ed74e65565af4b65a3daf1a75084c2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:27.237404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-04d12811-8f95-4848-9b6d-b8deb170c6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:27.310602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1228/2424] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:27.322341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:27.324459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:27.385780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dff88-3504-4159-a163-893c51e93494 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:27.390452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:27.391050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:27.391326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:27.391595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:27.400334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:27.401772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:27.410708 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1197/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:30.590491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2acf70-a91b-4435-8f42-bdff5a02fc57 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:30.591085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2acf70-a91b-4435-8f42-bdff5a02fc57 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:30.591085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2acf70-a91b-4435-8f42-bdff5a02fc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:30.615130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2a2acf70-a91b-4435-8f42-bdff5a02fc57 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:30.616391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2a2acf70-a91b-4435-8f42-bdff5a02fc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:30.675287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1229/2426] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:30.698167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:30.699793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:30.775289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb99c8-d7b9-4ab6-8a81-402a8071b3a6 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:30.780598 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b2b22-e67d-4360-9293-6e08f702a01c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:30.781152 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b2b22-e67d-4360-9293-6e08f702a01c service swift] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:30.781431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b2b22-e67d-4360-9293-6e08f702a01c service swift] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:30.781690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b2b22-e67d-4360-9293-6e08f702a01c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:30.790304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b2b22-e67d-4360-9293-6e08f702a01c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:30.791924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b2b22-e67d-4360-9293-6e08f702a01c service swift] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:30.800100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1198/2427] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:01:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:01:37.833948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2acf70-a91b-4435-8f42-bdff5a02fc57 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:37.900772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:37.913620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2acf70-a91b-4435-8f42-bdff5a02fc57 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:37.919134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:37.920041 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:37.920189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:37.920333 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] PATH_INFO: `/v3/users/ed74e65565af4b65a3daf1a75084c2ed` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:37.921519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed74e65565af4b65a3daf1a75084c2ed)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:37.923449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:37.976872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed74e65565af4b65a3daf1a75084c2ed'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:37.987005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed74e65565af4b65a3daf1a75084c2ed'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.011351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed74e65565af4b65a3daf1a75084c2ed'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.012606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed74e65565af4b65a3daf1a75084c2ed'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.044480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed74e65565af4b65a3daf1a75084c2ed'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.051400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1230/2428] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:01:37 2022] DELETE /identity/v3/users/ed74e65565af4b65a3daf1a75084c2ed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:01:38.056205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379508-094f-4800-8200-fe735c16b88d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:38.057109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379508-094f-4800-8200-fe735c16b88d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:38.057378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379508-094f-4800-8200-fe735c16b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:38.078827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-65379508-094f-4800-8200-fe735c16b88d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:38.080004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-65379508-094f-4800-8200-fe735c16b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:38.106704 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:38.174323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1199/2429] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:01:38.185076 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:38.186851 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:38.266640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3338b-95e9-47fd-a56b-56dfb6972931 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:38.270261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:38.270874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:38.271142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:38.271417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:38.281103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:38.282559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:38.293450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1231/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:38.657649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65379508-094f-4800-8200-fe735c16b88d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:38.659451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-65379508-094f-4800-8200-fe735c16b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:38.688090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65379508-094f-4800-8200-fe735c16b88d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:38.694404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:38.695184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:38.695461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:38.695915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] PATH_INFO: `/v3/projects/282bd50425164607974fdfc19762f9c7` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:38.696986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=282bd50425164607974fdfc19762f9c7)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:38.700766 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:38.758296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282bd50425164607974fdfc19762f9c7', 'request_id': 'req-1794e525-f353-458d-a428-ad6dbbdaa09b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.767360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282bd50425164607974fdfc19762f9c7', 'request_id': 'req-1794e525-f353-458d-a428-ad6dbbdaa09b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.774005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282bd50425164607974fdfc19762f9c7', 'request_id': 'req-1794e525-f353-458d-a428-ad6dbbdaa09b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.786109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] The token cache is being invalidate because project 282bd50425164607974fdfc19762f9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:01:38.786396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.787059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1794e525-f353-458d-a428-ad6dbbdaa09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:01:38.788627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1200/2431] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:01:38 2022] DELETE /identity/v3/projects/282bd50425164607974fdfc19762f9c7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:01:47.536053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:47.538681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:47.617132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e16091-2c1b-4c75-943c-e2f43f0c66f4 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:47.630605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:47.684415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:47.685066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:47.685344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:47.685608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:47.687598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:47.699393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:47.700969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:47.711452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1232/2432] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:01:48.386193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c39c-6dc6-4477-85b0-b9e6de3e0e10 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:48.386709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c39c-6dc6-4477-85b0-b9e6de3e0e10 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:48.386797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c39c-6dc6-4477-85b0-b9e6de3e0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:48.406916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-7d01c39c-6dc6-4477-85b0-b9e6de3e0e10 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:48.408161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7d01c39c-6dc6-4477-85b0-b9e6de3e0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:48.469525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1201/2433] 10.222.0.42 () {58 vars in 967 bytes} [Thu Sep 15 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:48.482853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:01:48.484316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:48.555158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a930b1-8cd7-45c1-a52c-a986fff47319 service placement] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:01:48.561743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980ae5-d55d-4923-8559-f6912eebaf93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:01:48.562614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ae5-d55d-4923-8559-f6912eebaf93 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:48.562969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ae5-d55d-4923-8559-f6912eebaf93 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:48.563311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980ae5-d55d-4923-8559-f6912eebaf93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:48.577489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980ae5-d55d-4923-8559-f6912eebaf93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:01:48.579788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980ae5-d55d-4923-8559-f6912eebaf93 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:01:48.589331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1233/2434] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:01:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:01:52.724189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:01:52.724699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:01:52.724699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:01:52.746676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] MFA Rules not processed for user `887067502abe4ada8ba7053acd576f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:01:52.747918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:01:52.799577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:01:52.813168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1202/2435] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:01:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:01:58.585550 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=56 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:02.811565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:06.938665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9617-98fa-472e-93e8-f266e1a852be None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:06.939221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9617-98fa-472e-93e8-f266e1a852be None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:06.939221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9617-98fa-472e-93e8-f266e1a852be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:06.965121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f66a9617-98fa-472e-93e8-f266e1a852be None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:06.966475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f66a9617-98fa-472e-93e8-f266e1a852be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:07.029583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1234/2436] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:07.045063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:07.046712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:07.129264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4881b6-e803-45e7-853f-5a6f85371aba None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:07.135088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:07.135724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:07.136010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:07.136274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:07.144736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:07.146315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:07.155955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1203/2437] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:02:10.263685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d694d-0e15-4664-bc7a-0e1e4250fd9e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:10.264288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d694d-0e15-4664-bc7a-0e1e4250fd9e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:10.264288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d694d-0e15-4664-bc7a-0e1e4250fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:10.285429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-bf1d694d-0e15-4664-bc7a-0e1e4250fd9e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:10.286629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bf1d694d-0e15-4664-bc7a-0e1e4250fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:10.296026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1235/2438] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:10.313048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:10.324543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb8b7-fbc8-4d8d-9ede-283a3feb4726 service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:10.330602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:10.331196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:10.331468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:10.331739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:10.340304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:10.342093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:10.351402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1204/2439] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:02:13.385439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21dba6-a50b-477b-8b27-e57f9d978d0f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:13.385962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21dba6-a50b-477b-8b27-e57f9d978d0f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:13.385962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21dba6-a50b-477b-8b27-e57f9d978d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:13.409388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-bd21dba6-a50b-477b-8b27-e57f9d978d0f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:13.410694 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bd21dba6-a50b-477b-8b27-e57f9d978d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:13.420526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1236/2440] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:13.441189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:13.455484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e673e-8ca1-4f99-baf9-286c0d05be3b service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:13.462556 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:13.463157 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:13.463429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:13.463690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:13.472326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:13.473894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:13.483555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1205/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:02:16.538620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362616-f391-4d97-ac19-0821c2ccf5ea None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:16.539111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362616-f391-4d97-ac19-0821c2ccf5ea None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:16.539111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90362616-f391-4d97-ac19-0821c2ccf5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:16.560204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-90362616-f391-4d97-ac19-0821c2ccf5ea None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:16.561588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-90362616-f391-4d97-ac19-0821c2ccf5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:16.572044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1237/2442] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:16.598874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:16.611205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676436d-7d2b-4213-a9d5-af8c6a64d0b8 service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:16.618217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:16.618839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:16.619115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:16.619378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:16.629049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:16.630637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:16.640081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1206/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:02:19.718055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fefe-3d0b-4360-adcc-176261d66bea None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:19.718577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fefe-3d0b-4360-adcc-176261d66bea None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:19.718577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fefe-3d0b-4360-adcc-176261d66bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:19.739987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-efc6fefe-3d0b-4360-adcc-176261d66bea None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:19.741181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-efc6fefe-3d0b-4360-adcc-176261d66bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:19.751294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1238/2444] 10.222.0.59 () {58 vars in 1016 bytes} [Thu Sep 15 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:19.772912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:19.784600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f302d-4eb2-4a94-9c79-ddc9adf14063 service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:19.791688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f25f5c-a5dd-444f-a03b-a4e24833348f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:19.792250 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f25f5c-a5dd-444f-a03b-a4e24833348f service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:19.792520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f25f5c-a5dd-444f-a03b-a4e24833348f service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:19.792779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f25f5c-a5dd-444f-a03b-a4e24833348f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:19.801653 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f25f5c-a5dd-444f-a03b-a4e24833348f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:19.803282 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f25f5c-a5dd-444f-a03b-a4e24833348f service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:19.813274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1207/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:02:22.746166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:22.746667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:22.746761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:22.768812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] MFA Rules not processed for user `cb0d882b2ac745399a6d1e524c464676`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:22.770031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:22.830023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1239/2446] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:29.808690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=58 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:32.822609 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=64 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:40.277141 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38b31b-c82d-4707-8263-c8948624f146 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:40.277699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38b31b-c82d-4707-8263-c8948624f146 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:40.277699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38b31b-c82d-4707-8263-c8948624f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:40.300822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3f38b31b-c82d-4707-8263-c8948624f146 None None] MFA Rules not processed for user `e270bd406d644bf89649f40f66166430`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:40.302143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3f38b31b-c82d-4707-8263-c8948624f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:40.361541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1208/2447] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:50.354390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=25 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:52.373039 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:52.375269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:52.391721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03206d9e-0080-40a0-9d5b-7c4110fb1434 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:52.397653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:52.399160 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:52.399623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:52.400063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] PATH_INFO: `/v3/users/887067502abe4ada8ba7053acd576f15` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:52.402967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=887067502abe4ada8ba7053acd576f15)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:52.406365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:52.493698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887067502abe4ada8ba7053acd576f15'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:52.507467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887067502abe4ada8ba7053acd576f15'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:52.518617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887067502abe4ada8ba7053acd576f15'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:52.520398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887067502abe4ada8ba7053acd576f15'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:52.536126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3ee1f61d-e066-4c5b-8720-22e4219aad73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887067502abe4ada8ba7053acd576f15'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:52.543748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1240/2448] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:02:52 2022] DELETE /identity/v3/users/887067502abe4ada8ba7053acd576f15 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:02:53.033796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38b31b-c82d-4707-8263-c8948624f146 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.049111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38b31b-c82d-4707-8263-c8948624f146 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.113997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.114644 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.115176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.115649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] PATH_INFO: `/v3/projects/9270ceb33dd048b480138bca84cf31e6` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.117577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9270ceb33dd048b480138bca84cf31e6)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.125378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.181398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9270ceb33dd048b480138bca84cf31e6', 'request_id': 'req-7b5253fe-8125-410b-813d-7cefeeb301cc'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:53.191757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9270ceb33dd048b480138bca84cf31e6', 'request_id': 'req-7b5253fe-8125-410b-813d-7cefeeb301cc'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:53.200353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9270ceb33dd048b480138bca84cf31e6', 'request_id': 'req-7b5253fe-8125-410b-813d-7cefeeb301cc'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:53.219405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] The token cache is being invalidate because project 9270ceb33dd048b480138bca84cf31e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:02:53.220075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:53.220977 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7b5253fe-8125-410b-813d-7cefeeb301cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:53.223920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1209/2449] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:02:53 2022] DELETE /identity/v3/projects/9270ceb33dd048b480138bca84cf31e6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:02:53.228626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac638c-edfc-4a0e-a4fc-674f6393939e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.228917 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac638c-edfc-4a0e-a4fc-674f6393939e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.229188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac638c-edfc-4a0e-a4fc-674f6393939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.272047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b4ac638c-edfc-4a0e-a4fc-674f6393939e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:53.274195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b4ac638c-edfc-4a0e-a4fc-674f6393939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:53.354117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1241/2450] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:53.362064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32cba-2311-43f5-9ead-7ea81fe9e629 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.362639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32cba-2311-43f5-9ead-7ea81fe9e629 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.363104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a32cba-2311-43f5-9ead-7ea81fe9e629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.386431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d6a32cba-2311-43f5-9ead-7ea81fe9e629 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:53.387677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d6a32cba-2311-43f5-9ead-7ea81fe9e629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:53.401500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1210/2451] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:53.402431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac638c-edfc-4a0e-a4fc-674f6393939e None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.413161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac638c-edfc-4a0e-a4fc-674f6393939e None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.418058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.418780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.419135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.419474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.420234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:02:53.420659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.422345 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.440641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1242/2452] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:02:53.441311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a32cba-2311-43f5-9ead-7ea81fe9e629 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.450996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a32cba-2311-43f5-9ead-7ea81fe9e629 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.455915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.456539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.456838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.457077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.457721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.459650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.496233 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1211/2453] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:02:53 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:02:53.497405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.510253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ca75-ff01-47f5-80dd-569540eafddc admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.585361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17f739-d95c-45e4-a038-2110339db766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.586892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17f739-d95c-45e4-a038-2110339db766 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.586892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17f739-d95c-45e4-a038-2110339db766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.586892 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17f739-d95c-45e4-a038-2110339db766 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.587249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17f739-d95c-45e4-a038-2110339db766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.589684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17f739-d95c-45e4-a038-2110339db766 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.598359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:53.619967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1243/2454] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:02:53 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:02:53.625140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.625307 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e769e8-3cb0-4ec0-8071-ae8f61339958 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.625648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e769e8-3cb0-4ec0-8071-ae8f61339958 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.625991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e769e8-3cb0-4ec0-8071-ae8f61339958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.637873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4346dd-cedf-46be-a3eb-dab981d0e9ce admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.643345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.644648 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.645110 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.645635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.646289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.647372 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-14e769e8-3cb0-4ec0-8071-ae8f61339958 None None] MFA Rules not processed for user `1d2b0118b29b4764bd270bdcd28c363a`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:53.648373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.648685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-14e769e8-3cb0-4ec0-8071-ae8f61339958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:53.673523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1212/2455] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:02:53.677486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.691003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfddf4-3652-4c4a-b5db-fa41906f2e1d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.696139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.696751 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.697190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.697458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.698092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.699821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.710595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1213/2456] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:02:53.715182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.726371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2379f-6c9b-4659-a120-f2bbf1898424 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.730973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1244/2457] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:53.734237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.735095 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.735220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.735455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] PATH_INFO: `/v3/projects/8ac7968481734722b796879f4e1ef584/users/7c89e6e4948c43078d2994d1d92440a4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.754028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac7968481734722b796879f4e1ef584, user_id=7c89e6e4948c43078d2994d1d92440a4, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.756721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.771283 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1214/2458] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:02:53 2022] PUT /identity/v3/projects/8ac7968481734722b796879f4e1ef584/users/7c89e6e4948c43078d2994d1d92440a4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:02:53.781779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4ce05-a823-45ba-9dc0-eb9c605446a6 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.782080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4ce05-a823-45ba-9dc0-eb9c605446a6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.782328 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4ce05-a823-45ba-9dc0-eb9c605446a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.813859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-12f4ce05-a823-45ba-9dc0-eb9c605446a6 None None] MFA Rules not processed for user `7c89e6e4948c43078d2994d1d92440a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:53.815131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-12f4ce05-a823-45ba-9dc0-eb9c605446a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:53.881466 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1245/2459] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:53.893395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:53.895394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:53.916420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:53.960637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68f9d2-3006-489c-8fd7-427633d5f350 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:53.964933 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b365e6-8e3b-47f1-8e04-bd1634765eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:53.965533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b365e6-8e3b-47f1-8e04-bd1634765eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:53.965809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b365e6-8e3b-47f1-8e04-bd1634765eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:53.966076 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b365e6-8e3b-47f1-8e04-bd1634765eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:53.974647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b365e6-8e3b-47f1-8e04-bd1634765eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:53.976618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b365e6-8e3b-47f1-8e04-bd1634765eaf service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:53.986536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1215/2460] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:02:59.098681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4ce05-a823-45ba-9dc0-eb9c605446a6 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:59.163394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4ce05-a823-45ba-9dc0-eb9c605446a6 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:59.167965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:59.168592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:59.168862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:59.169123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] PATH_INFO: `/v3/users/7c89e6e4948c43078d2994d1d92440a4` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:59.170216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c89e6e4948c43078d2994d1d92440a4)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:59.172294 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:59.202361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:02:59.223339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c89e6e4948c43078d2994d1d92440a4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.232109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c89e6e4948c43078d2994d1d92440a4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.239200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c89e6e4948c43078d2994d1d92440a4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.239875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c89e6e4948c43078d2994d1d92440a4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.251447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c89e6e4948c43078d2994d1d92440a4'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.257394 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1246/2461] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:02:59 2022] DELETE /identity/v3/users/7c89e6e4948c43078d2994d1d92440a4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:02:59.262004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:59.262502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:59.262599 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:59.282572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:02:59.283801 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:59.351935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1216/2462] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:02:59.362485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:59.364985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:59.431344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa21c2-15ba-4a3d-b1ae-3d48b3713b50 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:59.438807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:59.439497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:59.439911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:59.440316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:59.451321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:59.452778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:59.462344 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1247/2463] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:02:59.744127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:02:59.745612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:02:59.764473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a1650-4434-451a-9927-cf7402cc5f4e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:02:59.771111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:02:59.772147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:02:59.772419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:02:59.772676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] PATH_INFO: `/v3/projects/8ac7968481734722b796879f4e1ef584` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:02:59.774061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac7968481734722b796879f4e1ef584)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:02:59.776269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:02:59.826880 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac7968481734722b796879f4e1ef584', 'request_id': 'req-7f587335-df21-45cb-87a2-f2dda2ae07d0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.835934 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac7968481734722b796879f4e1ef584', 'request_id': 'req-7f587335-df21-45cb-87a2-f2dda2ae07d0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.842042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac7968481734722b796879f4e1ef584', 'request_id': 'req-7f587335-df21-45cb-87a2-f2dda2ae07d0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.852968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] The token cache is being invalidate because project 8ac7968481734722b796879f4e1ef584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:02:59.853304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.853866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:02:59.855324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1217/2464] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:02:59 2022] DELETE /identity/v3/projects/8ac7968481734722b796879f4e1ef584 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:03:09.458058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=6,keystone:SELECT=45,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:09.850488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:29.451672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:29.454187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:29.468932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1809dd0-06cc-4dfc-938a-ca4561c49031 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:29.525632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:29.526158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:29.526434 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:29.526700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] PATH_INFO: `/v3/users/cb0d882b2ac745399a6d1e524c464676` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:29.527867 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0d882b2ac745399a6d1e524c464676)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:29.529794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:29.579239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0d882b2ac745399a6d1e524c464676'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.587486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0d882b2ac745399a6d1e524c464676'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.596197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0d882b2ac745399a6d1e524c464676'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.596824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0d882b2ac745399a6d1e524c464676'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.608572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cdeef908-4735-4b27-bfcb-3ac27d601491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0d882b2ac745399a6d1e524c464676'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.615204 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1248/2465] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:03:29 2022] DELETE /identity/v3/users/cb0d882b2ac745399a6d1e524c464676 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:03:29.808730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:29.810309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:29.827316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f587335-df21-45cb-87a2-f2dda2ae07d0 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:29.888921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:29.889577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:29.889849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:29.890118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] PATH_INFO: `/v3/projects/00e2d054379e488aa192bf655396fe62` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:29.891349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e2d054379e488aa192bf655396fe62)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:29.893878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:29.942146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e2d054379e488aa192bf655396fe62', 'request_id': 'req-715bc496-60d1-47b5-a47c-f61a366ac235'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.950252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e2d054379e488aa192bf655396fe62', 'request_id': 'req-715bc496-60d1-47b5-a47c-f61a366ac235'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.956196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e2d054379e488aa192bf655396fe62', 'request_id': 'req-715bc496-60d1-47b5-a47c-f61a366ac235'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.967764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] The token cache is being invalidate because project 00e2d054379e488aa192bf655396fe62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:03:29.968045 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.968682 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715bc496-60d1-47b5-a47c-f61a366ac235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:03:29.970209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1218/2466] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:03:29 2022] DELETE /identity/v3/projects/00e2d054379e488aa192bf655396fe62 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:03:29.975379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99975-bc70-4592-8405-f8939f7ff15c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:29.975660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99975-bc70-4592-8405-f8939f7ff15c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:29.975961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b99975-bc70-4592-8405-f8939f7ff15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:29.996604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c0b99975-bc70-4592-8405-f8939f7ff15c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:03:29.997802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c0b99975-bc70-4592-8405-f8939f7ff15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:30.066811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1249/2467] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:03:30.075533 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb79a-43ca-434b-ad06-d5383ff5e8fe None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.075874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb79a-43ca-434b-ad06-d5383ff5e8fe None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.076204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb79a-43ca-434b-ad06-d5383ff5e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.099143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d98cb79a-43ca-434b-ad06-d5383ff5e8fe None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:03:30.100401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d98cb79a-43ca-434b-ad06-d5383ff5e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:30.109372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1219/2468] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:03:30.114189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b99975-bc70-4592-8405-f8939f7ff15c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:30.125885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b99975-bc70-4592-8405-f8939f7ff15c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:30.132209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:30.132826 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.133096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.133356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.134001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:03:30.134300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:30.136013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:30.149180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1250/2469] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:03:30.153728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cb79a-43ca-434b-ad06-d5383ff5e8fe None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:30.163570 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cb79a-43ca-434b-ad06-d5383ff5e8fe None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:30.169006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:30.169621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.169924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.170225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.170829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:30.173448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:30.209527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1220/2470] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:03:30 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:03:30.214454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:30.224949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6eb5d-6df9-4e4f-8c44-f898a02a8092 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:30.228528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:30.286147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:30.286753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.287044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.287304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.287957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:30.289860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:30.314264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1251/2471] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:03:30 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:03:30.318661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:30.329309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1b952-d691-4c54-bb80-0b56e90ce817 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:30.334612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:30.335216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.335492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.335798 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.336804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:30.338410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:30.348983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1221/2472] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:03:30.353137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:30.363517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b864a6b-f858-4fc5-972f-8b5d60a7a7f6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:30.369389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f08db-2f8c-4731-b0dc-ea1b19eff7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:30.369990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f08db-2f8c-4731-b0dc-ea1b19eff7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.370264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f08db-2f8c-4731-b0dc-ea1b19eff7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.370527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f08db-2f8c-4731-b0dc-ea1b19eff7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.371163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f08db-2f8c-4731-b0dc-ea1b19eff7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:30.372792 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f08db-2f8c-4731-b0dc-ea1b19eff7b8 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:30.384153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1252/2473] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:03:30.388585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:30.398951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc49f8-f8e2-4193-bd3b-8c6fe7682c01 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:30.403950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:30.404582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.404877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.405145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] PATH_INFO: `/v3/projects/6ac88fff43d24eb5b87c47bfcaa82442/users/1aff5c3ba252435fb64568ee34d2d986/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.420070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac88fff43d24eb5b87c47bfcaa82442, user_id=1aff5c3ba252435fb64568ee34d2d986, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:30.422857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:30.437918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1222/2474] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:03:30 2022] PUT /identity/v3/projects/6ac88fff43d24eb5b87c47bfcaa82442/users/1aff5c3ba252435fb64568ee34d2d986/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:03:30.443266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843962b2-4d1c-440c-b1a4-cd81fcfaf281 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.443571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843962b2-4d1c-440c-b1a4-cd81fcfaf281 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.443884 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843962b2-4d1c-440c-b1a4-cd81fcfaf281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.463608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-843962b2-4d1c-440c-b1a4-cd81fcfaf281 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:03:30.464864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-843962b2-4d1c-440c-b1a4-cd81fcfaf281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:30.532807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1253/2475] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:03:30.546097 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:30.548350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:30.583758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:30.615686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458bd3d-7a75-4da4-a4f1-8a5582317c3a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:30.619667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:30.620306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:30.620577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:30.620838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:30.630347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:30.631794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:30.641245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1223/2476] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:03:34.569228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d969-7756-4371-b882-1c7344f47d95 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:34.569735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d969-7756-4371-b882-1c7344f47d95 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:34.569735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d969-7756-4371-b882-1c7344f47d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:34.600029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-7261d969-7756-4371-b882-1c7344f47d95 None None] MFA Rules not processed for user `1aff5c3ba252435fb64568ee34d2d986`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:03:34.601235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7261d969-7756-4371-b882-1c7344f47d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:34.664868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1254/2477] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:03:34.679825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:34.681390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:34.760684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f1cc0-4242-40bc-89d9-fa2733cabee4 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:34.766357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:34.766962 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:34.767234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:34.767495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:34.776424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:34.778014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:34.786756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1224/2478] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:03:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:03:36.170449 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad158-d546-44ae-bb48-2ae89556ea40 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:36.170978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad158-d546-44ae-bb48-2ae89556ea40 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:36.170978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad158-d546-44ae-bb48-2ae89556ea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:36.192670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-d04ad158-d546-44ae-bb48-2ae89556ea40 None None] MFA Rules not processed for user `1aff5c3ba252435fb64568ee34d2d986`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:03:36.193888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d04ad158-d546-44ae-bb48-2ae89556ea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:36.202060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1255/2479] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:03:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:03:38.197900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:38.199538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:38.216830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2bd7f-5aef-4114-a952-f6771824f382 service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:38.220896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd6215-8fbe-43fe-b529-467fa8eb450c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:38.221536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6215-8fbe-43fe-b529-467fa8eb450c service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:38.221865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6215-8fbe-43fe-b529-467fa8eb450c service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:38.222088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6215-8fbe-43fe-b529-467fa8eb450c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:38.239218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-07fd6215-8fbe-43fe-b529-467fa8eb450c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:38.266229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd6215-8fbe-43fe-b529-467fa8eb450c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:38.267595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd6215-8fbe-43fe-b529-467fa8eb450c service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:38.285755 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1225/2480] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:03:38.724492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ad158-d546-44ae-bb48-2ae89556ea40 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:38.734302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ad158-d546-44ae-bb48-2ae89556ea40 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:38.738287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:38.738947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:38.739219 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:38.739487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:38.741350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:38.753329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:38.756042 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:38.757860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:38.770523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1256/2481] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:03:44.690909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:44.691540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:44.691540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:44.714384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:03:44.715611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:44.774862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1226/2482] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:03:44.827618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:44.829132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:44.899234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8bf0d-7210-4456-a154-ce39f15feba4 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:44.904389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:44.905011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:44.905287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:44.905557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:44.914168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:44.915812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:44.924549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1257/2483] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:03:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:03:51.075156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:51.076618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:51.135384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:51.141478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c9e90-8eaf-4c5e-9391-1d289c16750c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:51.146605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:51.147243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:51.147520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:51.147815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:51.149757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:51.215303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:51.216721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:51.228853 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1227/2484] 10.222.0.42 () {60 vars in 1396 bytes} [Thu Sep 15 13:03:51 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:03:54.925941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=34 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:03:56.135630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:56.152224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0719a2-ab46-4c47-afca-1e7ba7e349f8 service swift] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:56.161865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd1172-0df1-4da3-8d72-eebe2784c2c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:56.162492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd1172-0df1-4da3-8d72-eebe2784c2c3 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:56.162763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd1172-0df1-4da3-8d72-eebe2784c2c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:56.163049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd1172-0df1-4da3-8d72-eebe2784c2c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:56.165180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fbcd1172-0df1-4da3-8d72-eebe2784c2c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:56.226695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:03:56.228388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:03:56.229287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd1172-0df1-4da3-8d72-eebe2784c2c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:56.230883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd1172-0df1-4da3-8d72-eebe2784c2c3 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:56.240775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1258/2485] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:03:56.288013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fac91f-290a-48f6-84e4-efe623405976 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:03:56.291515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349015c-9ea3-4673-8431-893b2dd0937d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:03:56.292165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349015c-9ea3-4673-8431-893b2dd0937d service glance] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:03:56.292432 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349015c-9ea3-4673-8431-893b2dd0937d service glance] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:03:56.292694 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349015c-9ea3-4673-8431-893b2dd0937d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:03:56.301649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349015c-9ea3-4673-8431-893b2dd0937d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:03:56.303352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349015c-9ea3-4673-8431-893b2dd0937d service glance] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:03:56.313011 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1228/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:00.949759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d203-5021-4ec6-86d0-8b909742fbc0 None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:00.950659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d203-5021-4ec6-86d0-8b909742fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:00.951291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d203-5021-4ec6-86d0-8b909742fbc0 None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:00.952723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1259/2487] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 13:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 13:04:00.961318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6cdf2-68ea-4edf-a515-8ad93b9fd8ab None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:00.961870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6cdf2-68ea-4edf-a515-8ad93b9fd8ab None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:00.961870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6cdf2-68ea-4edf-a515-8ad93b9fd8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:00.984849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9ab6cdf2-68ea-4edf-a515-8ad93b9fd8ab None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:00.986115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9ab6cdf2-68ea-4edf-a515-8ad93b9fd8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:00.996395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1229/2488] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:01.008667 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d203-5021-4ec6-86d0-8b909742fbc0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:01.019938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d203-5021-4ec6-86d0-8b909742fbc0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:01.026172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed54cf-0f9a-4827-8a83-9888833e78d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:01.026914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed54cf-0f9a-4827-8a83-9888833e78d3 service glance] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.027292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed54cf-0f9a-4827-8a83-9888833e78d3 service glance] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.027780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed54cf-0f9a-4827-8a83-9888833e78d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.040426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed54cf-0f9a-4827-8a83-9888833e78d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:01.041991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed54cf-0f9a-4827-8a83-9888833e78d3 service glance] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:01.054412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1260/2489] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:01.138276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2d25-8299-40b2-879c-e2a2dc16fb72 None None] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.138645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2d25-8299-40b2-879c-e2a2dc16fb72 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.138915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2d25-8299-40b2-879c-e2a2dc16fb72 None None] PATH_INFO: `/` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.140316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1230/2490] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 13:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 13:04:01.145132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230b13-7b6a-4bb9-bfdb-4d49c446b04c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.145524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230b13-7b6a-4bb9-bfdb-4d49c446b04c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.145878 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33230b13-7b6a-4bb9-bfdb-4d49c446b04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.166855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-33230b13-7b6a-4bb9-bfdb-4d49c446b04c None None] MFA Rules not processed for user `3a022b80e5eb460b92e4e99728b22770`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:01.168262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-33230b13-7b6a-4bb9-bfdb-4d49c446b04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:01.176002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1261/2491] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 13:04:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:04:01.188921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd2d25-8299-40b2-879c-e2a2dc16fb72 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:01.201734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd2d25-8299-40b2-879c-e2a2dc16fb72 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:01.206323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204c5fc-d81e-4531-96e6-4a392f5404d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:01.207008 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c5fc-d81e-4531-96e6-4a392f5404d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.207396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c5fc-d81e-4531-96e6-4a392f5404d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.207840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204c5fc-d81e-4531-96e6-4a392f5404d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.217120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204c5fc-d81e-4531-96e6-4a392f5404d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:01.218897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204c5fc-d81e-4531-96e6-4a392f5404d8 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:01.226779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1231/2492] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:01.364297 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c791-9342-4709-8682-26e36985899b None None] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.364584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c791-9342-4709-8682-26e36985899b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.364844 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86c791-9342-4709-8682-26e36985899b None None] PATH_INFO: `/` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.366270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1262/2493] 10.222.0.42 () {54 vars in 921 bytes} [Thu Sep 15 13:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 13:04:01.372386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.372666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.372938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.395545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] MFA Rules not processed for user `ac2cabfcf8224f70a3129dc308e67b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:01.396909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:01.406911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1232/2494] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Sep 15 13:04:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:01.419070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c791-9342-4709-8682-26e36985899b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:01.433188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86c791-9342-4709-8682-26e36985899b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:01.447721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b988aad-2abb-4684-91a4-93394e33c224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:01.448371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988aad-2abb-4684-91a4-93394e33c224 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.448641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988aad-2abb-4684-91a4-93394e33c224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.448901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988aad-2abb-4684-91a4-93394e33c224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.464582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988aad-2abb-4684-91a4-93394e33c224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:01.466304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988aad-2abb-4684-91a4-93394e33c224 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:01.478196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1263/2495] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:01.542405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:01.543972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:01.618091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb86ed-1f60-454d-ad9b-2e5414974fd6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:01.624326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:01.624941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:01.625215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:01.625466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:01.627397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:01.639280 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:01.640899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:01.650805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1233/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:04:03.344001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80145e-3f7d-46f4-92dd-5b6f2f6f339b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:03.344507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80145e-3f7d-46f4-92dd-5b6f2f6f339b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:03.344507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80145e-3f7d-46f4-92dd-5b6f2f6f339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:03.365097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1b80145e-3f7d-46f4-92dd-5b6f2f6f339b None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:03.366624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1b80145e-3f7d-46f4-92dd-5b6f2f6f339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:03.373946 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1264/2497] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:03.387077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:03.399105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae102192-c724-4140-b0c3-d100a1d1f939 service placement] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:03.404819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:03.405381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:03.405757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:03.405922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:03.411320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:03.415930 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:03.417896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:03.426558 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1234/2498] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:04:05.007021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80145e-3f7d-46f4-92dd-5b6f2f6f339b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:05.016707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80145e-3f7d-46f4-92dd-5b6f2f6f339b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:05.020405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:05.021242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:05.021696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:05.022101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:05.024266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:05.037983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:05.039439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:05.051096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1265/2499] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:09.217275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:09.218841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:09.249225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2887ba-1256-422b-ba97-08845d551484 service swift] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:09.254137 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:09.254867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:09.255211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:09.255613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] PATH_INFO: `/v3/users/1d2b0118b29b4764bd270bdcd28c363a` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:09.256945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2b0118b29b4764bd270bdcd28c363a)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:09.259043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:09.313080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2b0118b29b4764bd270bdcd28c363a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.323386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2b0118b29b4764bd270bdcd28c363a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.324339 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2b0118b29b4764bd270bdcd28c363a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.325470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2b0118b29b4764bd270bdcd28c363a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.336252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9d9abb59-c10f-486d-a77d-9ebca3b2a79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2b0118b29b4764bd270bdcd28c363a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.357792 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1235/2500] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:04:09 2022] DELETE /identity/v3/users/1d2b0118b29b4764bd270bdcd28c363a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:09.581734 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:09.602714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4d0b-f8a3-43bd-964b-6ea57fe72df8 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:09.690623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:09.691367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:09.691745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:09.692038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] PATH_INFO: `/v3/projects/a2ee68b74ab04bbcb9945e6f89e4152e` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:09.694009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ee68b74ab04bbcb9945e6f89e4152e)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:09.695997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:09.763009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:09.764984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ee68b74ab04bbcb9945e6f89e4152e', 'request_id': 'req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.781366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ee68b74ab04bbcb9945e6f89e4152e', 'request_id': 'req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.788754 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ee68b74ab04bbcb9945e6f89e4152e', 'request_id': 'req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.805000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] The token cache is being invalidate because project a2ee68b74ab04bbcb9945e6f89e4152e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:04:09.805326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.806115 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5ac4dde2-5a09-49dc-93a7-659a3eb0637a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:09.807970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1266/2501] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:04:09 2022] DELETE /identity/v3/projects/a2ee68b74ab04bbcb9945e6f89e4152e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:09.812778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0300-6e71-45fa-8750-49937d104e87 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:09.813183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0300-6e71-45fa-8750-49937d104e87 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:09.813417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0300-6e71-45fa-8750-49937d104e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:09.840251 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b7fb0300-6e71-45fa-8750-49937d104e87 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:09.841773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b7fb0300-6e71-45fa-8750-49937d104e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:09.914840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1236/2502] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:09.923662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb62d2a-ceaf-4cbe-b265-93e280477375 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:09.933535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb62d2a-ceaf-4cbe-b265-93e280477375 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:09.933535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb62d2a-ceaf-4cbe-b265-93e280477375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:09.946879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1eb62d2a-ceaf-4cbe-b265-93e280477375 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:09.948128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1eb62d2a-ceaf-4cbe-b265-93e280477375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:09.960389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1267/2503] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:09.961949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0300-6e71-45fa-8750-49937d104e87 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:09.978795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0300-6e71-45fa-8750-49937d104e87 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:09.984893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:09.985584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:09.985857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:09.986150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:09.986791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:04:09.987084 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:09.988765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:10.012667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1237/2504] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:04:10.017040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb62d2a-ceaf-4cbe-b265-93e280477375 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:10.027019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb62d2a-ceaf-4cbe-b265-93e280477375 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:10.032142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:10.032863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:10.033200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:10.034402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:10.034402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:10.036262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:10.080685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1268/2505] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:10 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:04:10.086002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:10.097200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeb44e-7051-41e0-b861-b3489e726eff admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:10.189002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:10.200130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:10.200858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:10.201396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:10.202006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:10.202691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:10.205068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:10.235592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1238/2506] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:10 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:04:10.238097 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:10.250561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278610c3-db8f-437d-9ba0-b9771229dd6c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:10.255617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:10.256446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:10.256726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:10.257004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:10.257642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:10.259270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:10.270283 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1269/2507] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:10.274687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:10.285518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436d26-19a1-4e58-8597-0e2d09cce943 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:10.291210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f7e6-1eaf-4cd2-85f1-f0338d82168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:10.292109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f7e6-1eaf-4cd2-85f1-f0338d82168f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:10.292452 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f7e6-1eaf-4cd2-85f1-f0338d82168f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:10.292823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f7e6-1eaf-4cd2-85f1-f0338d82168f admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:10.293610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f7e6-1eaf-4cd2-85f1-f0338d82168f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:10.295337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f7e6-1eaf-4cd2-85f1-f0338d82168f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:10.307955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1239/2508] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:10.312338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:10.324260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8e08d-8c47-430e-b6fb-7c5cdceb0a95 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:10.329499 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:10.330188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:10.330472 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:10.330744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] PATH_INFO: `/v3/projects/fee63778c3f44cb7b1be2e72b798e8c9/users/a9eebbe89e004c43a137df75840f3fb7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:10.347823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee63778c3f44cb7b1be2e72b798e8c9, user_id=a9eebbe89e004c43a137df75840f3fb7, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:10.350824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:10.366259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1270/2509] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:10 2022] PUT /identity/v3/projects/fee63778c3f44cb7b1be2e72b798e8c9/users/a9eebbe89e004c43a137df75840f3fb7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:10.376548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8571-77da-4631-b774-c3c77036af9b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:10.376909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8571-77da-4631-b774-c3c77036af9b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:10.377244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab8571-77da-4631-b774-c3c77036af9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:10.410840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9aab8571-77da-4631-b774-c3c77036af9b None None] MFA Rules not processed for user `a9eebbe89e004c43a137df75840f3fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:10.412426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9aab8571-77da-4631-b774-c3c77036af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:10.490504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1240/2510] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:10.501536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:10.503253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:10.579023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03af94-7609-47f4-a05a-5a3530255259 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:10.585276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a4c51-a321-45d0-92f2-4edd00c84c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:10.586006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a4c51-a321-45d0-92f2-4edd00c84c63 service nova] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:10.586145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a4c51-a321-45d0-92f2-4edd00c84c63 service nova] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:10.586406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a4c51-a321-45d0-92f2-4edd00c84c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:10.594922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a4c51-a321-45d0-92f2-4edd00c84c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:10.598054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a4c51-a321-45d0-92f2-4edd00c84c63 service nova] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:10.608859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1271/2511] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:16.039663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8571-77da-4631-b774-c3c77036af9b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:16.103972 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab8571-77da-4631-b774-c3c77036af9b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:16.108624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:16.109237 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.109511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.109781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] PATH_INFO: `/v3/users/a9eebbe89e004c43a137df75840f3fb7` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.110909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9eebbe89e004c43a137df75840f3fb7)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:16.112870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:16.165987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9eebbe89e004c43a137df75840f3fb7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.174098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9eebbe89e004c43a137df75840f3fb7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.174705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9eebbe89e004c43a137df75840f3fb7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.175304 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9eebbe89e004c43a137df75840f3fb7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.182458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9eebbe89e004c43a137df75840f3fb7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.183608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:16.201847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1241/2512] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:04:16 2022] DELETE /identity/v3/users/a9eebbe89e004c43a137df75840f3fb7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:04:16.206716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.207282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.207282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.227218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:16.228440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:16.277943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:16.293474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1272/2513] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:16.303865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:16.305685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:16.365234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69ca7f-ae40-44e1-a664-0b42bd759c50 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:16.369607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf5a61-74b5-487e-92a6-c7473940ca5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:16.370207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf5a61-74b5-487e-92a6-c7473940ca5c service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.370477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf5a61-74b5-487e-92a6-c7473940ca5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.370741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf5a61-74b5-487e-92a6-c7473940ca5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.380885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf5a61-74b5-487e-92a6-c7473940ca5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:16.382360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf5a61-74b5-487e-92a6-c7473940ca5c service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:16.391979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1242/2514] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:16.675360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:16.677277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:16.692645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd159f7-3088-4eb5-b28a-6c22e52ce322 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:16.699016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:16.699668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.699990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.700317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] PATH_INFO: `/v3/projects/fee63778c3f44cb7b1be2e72b798e8c9` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.701678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee63778c3f44cb7b1be2e72b798e8c9)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:16.703672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:16.766299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee63778c3f44cb7b1be2e72b798e8c9', 'request_id': 'req-83f312ab-fe35-44cb-9be8-d2d58e26e714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.775421 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee63778c3f44cb7b1be2e72b798e8c9', 'request_id': 'req-83f312ab-fe35-44cb-9be8-d2d58e26e714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.781304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee63778c3f44cb7b1be2e72b798e8c9', 'request_id': 'req-83f312ab-fe35-44cb-9be8-d2d58e26e714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.794711 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] The token cache is being invalidate because project fee63778c3f44cb7b1be2e72b798e8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:04:16.795033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.795853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:16.797532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1273/2515] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:04:16 2022] DELETE /identity/v3/projects/fee63778c3f44cb7b1be2e72b798e8c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:04:16.802949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9b182-d638-4208-9ded-775603d6d3c0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.803372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9b182-d638-4208-9ded-775603d6d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.803643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9b182-d638-4208-9ded-775603d6d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.828007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-aaf9b182-d638-4208-9ded-775603d6d3c0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:16.829222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-aaf9b182-d638-4208-9ded-775603d6d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:16.842510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:16.843990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:16.891549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1243/2516] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:04:16.901348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b184-7149-4618-8a0d-8d8a9d5cb43e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.901606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b184-7149-4618-8a0d-8d8a9d5cb43e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.901887 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b184-7149-4618-8a0d-8d8a9d5cb43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.908748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f312ab-fe35-44cb-9be8-d2d58e26e714 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:16.912941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:16.913872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.914142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.914542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.916473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:16.922765 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8f87b184-7149-4618-8a0d-8d8a9d5cb43e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:16.923964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8f87b184-7149-4618-8a0d-8d8a9d5cb43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:16.926358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:16.927872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:16.933478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1244/2517] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:04:16.936197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1274/2518] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:04:16.937954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87b184-7149-4618-8a0d-8d8a9d5cb43e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:16.948059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87b184-7149-4618-8a0d-8d8a9d5cb43e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:16.952744 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:16.953357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.953631 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.953898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.954538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:04:16.954836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:16.956472 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:16.969343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1245/2519] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:04:16.973907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:16.986991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0c9d-adfb-46f5-b21b-b3f7805feb95 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:16.992464 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:16.993075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:16.993380 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:16.993632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:16.994270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:16.996681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.030256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1275/2520] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:16 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:17.034674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.045516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc857a28-faa3-4300-9b95-879387ddff76 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.107190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.107844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.108130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.108422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.109049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.111002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.121461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:17.136120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1246/2521] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:17 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:17.142050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.152897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fcd47-b46d-4508-8a91-a835a414c728 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.158440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.159051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.159323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.159584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.160252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.161863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.173038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1276/2522] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:17.177344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.189322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733445a9-5065-43f7-bf4c-0b1c33b5d5e3 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.194194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d24ee1-63ef-4fe2-840c-7673ecf258b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.194829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24ee1-63ef-4fe2-840c-7673ecf258b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.195152 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24ee1-63ef-4fe2-840c-7673ecf258b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.195425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d24ee1-63ef-4fe2-840c-7673ecf258b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.196088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24ee1-63ef-4fe2-840c-7673ecf258b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.197709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d24ee1-63ef-4fe2-840c-7673ecf258b5 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.208935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1247/2523] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:17.214211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.224983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec8ac-5bd1-48d0-bf70-c2b1d6fd1c15 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.230545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.231323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.231659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.232014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] PATH_INFO: `/v3/projects/8632f0b75b17403ebd849b63e8e14af2/users/4e4924e252c8463a8a1a20ffaba2e798/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.247957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8632f0b75b17403ebd849b63e8e14af2, user_id=4e4924e252c8463a8a1a20ffaba2e798, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.250726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.265208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1277/2524] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:17 2022] PUT /identity/v3/projects/8632f0b75b17403ebd849b63e8e14af2/users/4e4924e252c8463a8a1a20ffaba2e798/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:17.276113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee39dc-6e84-4186-935a-9cacd371c1ec None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.276399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee39dc-6e84-4186-935a-9cacd371c1ec None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.276698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee39dc-6e84-4186-935a-9cacd371c1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.306425 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-78ee39dc-6e84-4186-935a-9cacd371c1ec None None] MFA Rules not processed for user `4e4924e252c8463a8a1a20ffaba2e798`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:17.307663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-78ee39dc-6e84-4186-935a-9cacd371c1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:17.374215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1248/2525] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:17.378914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.411099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:17.446869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798a459-4626-491d-adac-f49bb3aede4c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.451828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.452435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.452705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.452985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.453605 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.455515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.488011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1278/2526] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:17 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:17.492395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee39dc-6e84-4186-935a-9cacd371c1ec None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.503427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee39dc-6e84-4186-935a-9cacd371c1ec None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.570272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.570889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.571161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.571423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.572091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.573998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.597293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1249/2527] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:17 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:04:17.601737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.612202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8231a2-c29e-428f-a68d-ad356bd8eccb admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.617615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.618224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.618497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.618763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.619399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.621110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.631238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1279/2528] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:04:17.635647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.646125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171bd2-a61d-4bfc-8bb9-8158f78147b8 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.651979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.652627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.652898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.653161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] PATH_INFO: `/v3/projects/833bcb0fe393449f98c8f7e4297af5e0/users/76e1ba9d31c6484b84bbfb7da6a97fdc/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.668984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833bcb0fe393449f98c8f7e4297af5e0, user_id=76e1ba9d31c6484b84bbfb7da6a97fdc, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.671614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.692928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1250/2529] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:17 2022] PUT /identity/v3/projects/833bcb0fe393449f98c8f7e4297af5e0/users/76e1ba9d31c6484b84bbfb7da6a97fdc/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:04:17.697405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.707599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ffa2b-2fd9-4505-8f9f-3a08a168cd4d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.769837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a634245-f78b-4d75-9847-b813da6c263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.770447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634245-f78b-4d75-9847-b813da6c263f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.770715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634245-f78b-4d75-9847-b813da6c263f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.770973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634245-f78b-4d75-9847-b813da6c263f admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.771627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a634245-f78b-4d75-9847-b813da6c263f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.773278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a634245-f78b-4d75-9847-b813da6c263f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.783690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1280/2530] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:17.788841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.800016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b4479-8e04-47cd-a53f-ef7ee0d49d31 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:17.806824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:17.807486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.807797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.808068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] PATH_INFO: `/v3/projects/833bcb0fe393449f98c8f7e4297af5e0/users/76e1ba9d31c6484b84bbfb7da6a97fdc/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.810519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] RBAC: Authorizing `identity:create_grant(project_id=833bcb0fe393449f98c8f7e4297af5e0, user_id=76e1ba9d31c6484b84bbfb7da6a97fdc, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:17.813213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:17.825273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1251/2531] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:17 2022] PUT /identity/v3/projects/833bcb0fe393449f98c8f7e4297af5e0/users/76e1ba9d31c6484b84bbfb7da6a97fdc/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:17.837571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ecfe-35e7-482a-9249-ac1cb228cfa0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:17.837853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ecfe-35e7-482a-9249-ac1cb228cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:17.838124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ecfe-35e7-482a-9249-ac1cb228cfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:17.868031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0ca6ecfe-35e7-482a-9249-ac1cb228cfa0 None None] MFA Rules not processed for user `76e1ba9d31c6484b84bbfb7da6a97fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:17.869249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0ca6ecfe-35e7-482a-9249-ac1cb228cfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:17.943859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1281/2532] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:17.961309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:17.963139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:17.993211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:18.027424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510730b3-e6dc-461f-9cd3-6b877200910c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:18.031419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7c5d-585d-4eda-8abd-4de6d1f68679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:18.032059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7c5d-585d-4eda-8abd-4de6d1f68679 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:18.032333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7c5d-585d-4eda-8abd-4de6d1f68679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:18.032601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7c5d-585d-4eda-8abd-4de6d1f68679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:18.042235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7c5d-585d-4eda-8abd-4de6d1f68679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:18.043665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7c5d-585d-4eda-8abd-4de6d1f68679 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:18.054939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1252/2533] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:18.484460 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ecfe-35e7-482a-9249-ac1cb228cfa0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:18.511950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:18.512240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:18.512505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:18.518461 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:18.533481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:18.534722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:18.574578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ecfe-35e7-482a-9249-ac1cb228cfa0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:18.579125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:18.579821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:18.580199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:18.580474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] PATH_INFO: `/v3/users/4e4924e252c8463a8a1a20ffaba2e798` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:18.581606 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4924e252c8463a8a1a20ffaba2e798)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:18.583547 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:18.590727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1253/2534] 10.222.0.42 () {58 vars in 967 bytes} [Thu Sep 15 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:04:18.603584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:18.605041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:18.636125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4924e252c8463a8a1a20ffaba2e798'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:18.645200 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4924e252c8463a8a1a20ffaba2e798'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:18.656420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4924e252c8463a8a1a20ffaba2e798'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:18.657116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4924e252c8463a8a1a20ffaba2e798'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:18.669273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-42fbf115-6d8e-4595-9079-55b9211ddb13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4924e252c8463a8a1a20ffaba2e798'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:18.675308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1282/2535] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:04:18 2022] DELETE /identity/v3/users/4e4924e252c8463a8a1a20ffaba2e798 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:18.680021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:18.680310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:18.680607 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:18.686807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdb4e0-6b56-47c7-b8d6-eb1b3594b203 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:18.702723 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:18.703911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:18.758496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:18.759120 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:18.759399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:18.759671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:18.761524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:18.763271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1283/2536] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:04:18.773417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:18.774818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:18.779131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:18.820744 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:18.825369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:18.826973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:18.834786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c892b-a592-4a7c-9a01-a4ca4bf474fe None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:18.835937 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1254/2537] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:04:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:04:18.839342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:18.839912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:18.840190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:18.840456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:18.850802 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:18.852293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:18.862567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1284/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:19.172803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:19.174296 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:19.200538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829455b3-6f38-4382-aba6-9d4f8bc27748 service swift] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:19.210181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:19.211463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:19.212846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:19.213156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] PATH_INFO: `/v3/projects/8632f0b75b17403ebd849b63e8e14af2` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:19.214600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8632f0b75b17403ebd849b63e8e14af2)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:19.216728 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:19.276764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8632f0b75b17403ebd849b63e8e14af2', 'request_id': 'req-0b907386-7cbe-45e0-b806-94d26ec67b5a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.286365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8632f0b75b17403ebd849b63e8e14af2', 'request_id': 'req-0b907386-7cbe-45e0-b806-94d26ec67b5a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.294664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8632f0b75b17403ebd849b63e8e14af2', 'request_id': 'req-0b907386-7cbe-45e0-b806-94d26ec67b5a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.309366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] The token cache is being invalidate because project 8632f0b75b17403ebd849b63e8e14af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:04:19.309714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.310640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.312494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1255/2539] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:04:19 2022] DELETE /identity/v3/projects/8632f0b75b17403ebd849b63e8e14af2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:19.317078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:19.332148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31714e93-17af-4409-b8c8-e5585b65f554 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:19.402107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:19.402763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:19.403037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:19.403298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] PATH_INFO: `/v3/users/76e1ba9d31c6484b84bbfb7da6a97fdc` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:19.404540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e1ba9d31c6484b84bbfb7da6a97fdc)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:19.406541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:19.469865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e1ba9d31c6484b84bbfb7da6a97fdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.479751 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e1ba9d31c6484b84bbfb7da6a97fdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.487781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e1ba9d31c6484b84bbfb7da6a97fdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.488620 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e1ba9d31c6484b84bbfb7da6a97fdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.505280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-00757436-2f27-4022-a9c2-1a152a08a19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e1ba9d31c6484b84bbfb7da6a97fdc'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:19.512557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1285/2540] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:04:19 2022] DELETE /identity/v3/users/76e1ba9d31c6484b84bbfb7da6a97fdc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:19.980661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:19.982166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:19.997924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b907386-7cbe-45e0-b806-94d26ec67b5a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.068965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.069630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.069948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.070212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] PATH_INFO: `/v3/projects/833bcb0fe393449f98c8f7e4297af5e0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.071493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833bcb0fe393449f98c8f7e4297af5e0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.073497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.119543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:20.127298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833bcb0fe393449f98c8f7e4297af5e0', 'request_id': 'req-aed8d932-3f08-42b2-bb5a-07582b2d0026'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:20.138105 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833bcb0fe393449f98c8f7e4297af5e0', 'request_id': 'req-aed8d932-3f08-42b2-bb5a-07582b2d0026'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:20.147594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833bcb0fe393449f98c8f7e4297af5e0', 'request_id': 'req-aed8d932-3f08-42b2-bb5a-07582b2d0026'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:20.160023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] The token cache is being invalidate because project 833bcb0fe393449f98c8f7e4297af5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:04:20.160310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:20.161115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-aed8d932-3f08-42b2-bb5a-07582b2d0026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:20.162998 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1256/2541] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:04:19 2022] DELETE /identity/v3/projects/833bcb0fe393449f98c8f7e4297af5e0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:20.169537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0951-9720-4196-877c-ef257887d788 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.169787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0951-9720-4196-877c-ef257887d788 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.170090 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0951-9720-4196-877c-ef257887d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.191131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a54f0951-9720-4196-877c-ef257887d788 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:20.192408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a54f0951-9720-4196-877c-ef257887d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:20.259319 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1286/2542] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:20.268119 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69455c-96a1-46b1-acde-d034ef047341 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.268606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69455c-96a1-46b1-acde-d034ef047341 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.268606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69455c-96a1-46b1-acde-d034ef047341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.290817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-6f69455c-96a1-46b1-acde-d034ef047341 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:20.292075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-6f69455c-96a1-46b1-acde-d034ef047341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:20.301838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1257/2543] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:20.307010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f0951-9720-4196-877c-ef257887d788 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:20.315221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:20.319748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f0951-9720-4196-877c-ef257887d788 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.327964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.329222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.329644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.330094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.331164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:04:20.331578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.335034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.347050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1287/2544] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:04:20.353702 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69455c-96a1-46b1-acde-d034ef047341 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:20.364195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69455c-96a1-46b1-acde-d034ef047341 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.370771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.371384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.371661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.372034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.372664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.374590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.413857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1258/2545] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:20 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:20.419044 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:20.431819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb477e9-7599-4cc9-9b44-3d2035e95061 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.491634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.492377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.492521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.492808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.493442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.495377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.520383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1288/2546] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:20 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:20.524989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:20.535615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9eb13-b043-4560-9bdd-6189dd871cce admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.540886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.541498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.541773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.542043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.542683 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.544331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.554891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1259/2547] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:20.558979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:20.569894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2942bd-fc88-4718-8d4b-acb593b80158 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.575347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d317d9-5a1c-4a71-a1cb-c3d4a2703049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.575989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d317d9-5a1c-4a71-a1cb-c3d4a2703049 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.576261 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d317d9-5a1c-4a71-a1cb-c3d4a2703049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.576525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d317d9-5a1c-4a71-a1cb-c3d4a2703049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.577163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d317d9-5a1c-4a71-a1cb-c3d4a2703049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.578758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d317d9-5a1c-4a71-a1cb-c3d4a2703049 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.590161 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1289/2548] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:20.594632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:20.605382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815b383-4f22-475c-ba95-8f11d43ba164 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.610745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.611391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.611658 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.611943 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] PATH_INFO: `/v3/projects/4f42d652928a4521adcd1d52918a4228/users/0044e853972d4509a73ac07fa5934325/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.627571 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f42d652928a4521adcd1d52918a4228, user_id=0044e853972d4509a73ac07fa5934325, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.630246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.647799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1260/2549] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:20 2022] PUT /identity/v3/projects/4f42d652928a4521adcd1d52918a4228/users/0044e853972d4509a73ac07fa5934325/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:20.655731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90e163-e1cb-4858-8f07-e6d03f38e15f None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.656028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90e163-e1cb-4858-8f07-e6d03f38e15f None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.656291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90e163-e1cb-4858-8f07-e6d03f38e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.675456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9d90e163-e1cb-4858-8f07-e6d03f38e15f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:20.676680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9d90e163-e1cb-4858-8f07-e6d03f38e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:20.736444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1290/2550] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:20.747020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:20.749194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:20.825382 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce104800-d253-4168-b9a7-6266db707111 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:20.832209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:20.833055 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:20.833636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:20.833903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:20.844627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:20.846065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:20.855866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1261/2551] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:21.511144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a455-9c70-456a-be5a-a68329896efd None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:21.511671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a455-9c70-456a-be5a-a68329896efd None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:21.511795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a455-9c70-456a-be5a-a68329896efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:21.540276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-ae54a455-9c70-456a-be5a-a68329896efd None None] MFA Rules not processed for user `0044e853972d4509a73ac07fa5934325`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:21.541527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ae54a455-9c70-456a-be5a-a68329896efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:21.610973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:21.614907 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1291/2552] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:21.620198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:21.629928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca9196-7bf6-488a-b8d9-e6e0600afa10 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:21.635325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:21.635956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:21.636269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:21.636508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:21.637144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:21.639056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:21.668378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1262/2553] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:21 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:21.672422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a455-9c70-456a-be5a-a68329896efd None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:21.683382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a455-9c70-456a-be5a-a68329896efd None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:21.740577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:21.741331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:21.741615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:21.741883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:21.742528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:21.744495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:21.767736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1292/2554] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:21 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:04:21.771791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:21.782738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b5c37-4ef8-4a25-a801-e3d33fa9355f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:21.788735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:21.789321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:21.789636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:21.789894 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:21.790528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:21.792207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:21.803589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1263/2555] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:21.807783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:21.822873 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea1668-6704-4a61-a376-d9d04bfae75c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:21.830185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:21.831138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:21.831468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:21.831763 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] PATH_INFO: `/v3/projects/a86cfed5b7d44f55a01632469986bf34/users/f3e8f4e76f3b4d2da93a334271339c5b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:21.849073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86cfed5b7d44f55a01632469986bf34, user_id=f3e8f4e76f3b4d2da93a334271339c5b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:21.851881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:21.869512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1293/2556] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:21 2022] PUT /identity/v3/projects/a86cfed5b7d44f55a01632469986bf34/users/f3e8f4e76f3b4d2da93a334271339c5b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:21.873743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:21.884263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fb8a8-a130-4c5c-830c-b6a3fb9248a4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:21.918595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:21.951799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155a15-4e0b-4b0c-8e51-fb30c045c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:21.952415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155a15-4e0b-4b0c-8e51-fb30c045c722 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:21.952689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155a15-4e0b-4b0c-8e51-fb30c045c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:21.952953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155a15-4e0b-4b0c-8e51-fb30c045c722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:21.953587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155a15-4e0b-4b0c-8e51-fb30c045c722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:21.955193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155a15-4e0b-4b0c-8e51-fb30c045c722 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:21.968034 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1264/2557] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:21.972541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:21.983838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a830-b212-4907-ae83-e062bc879504 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:21.988974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244a8ac-2666-4f7a-ae1d-3c9761c29f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:21.989629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a8ac-2666-4f7a-ae1d-3c9761c29f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:21.989909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a8ac-2666-4f7a-ae1d-3c9761c29f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:21.990174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244a8ac-2666-4f7a-ae1d-3c9761c29f33 admin admin] PATH_INFO: `/v3/projects/a86cfed5b7d44f55a01632469986bf34/users/f3e8f4e76f3b4d2da93a334271339c5b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:21.992389 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244a8ac-2666-4f7a-ae1d-3c9761c29f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86cfed5b7d44f55a01632469986bf34, user_id=f3e8f4e76f3b4d2da93a334271339c5b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:21.995010 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244a8ac-2666-4f7a-ae1d-3c9761c29f33 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:22.007053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1294/2558] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:21 2022] PUT /identity/v3/projects/a86cfed5b7d44f55a01632469986bf34/users/f3e8f4e76f3b4d2da93a334271339c5b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:22.673967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:22.674474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:22.674474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:22.704679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] MFA Rules not processed for user `f3e8f4e76f3b4d2da93a334271339c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:22.706478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:22.781606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1265/2559] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:22.792855 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226e81f-4e40-4e64-b0f9-5bcab842d341 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:22.793391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226e81f-4e40-4e64-b0f9-5bcab842d341 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:22.793391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226e81f-4e40-4e64-b0f9-5bcab842d341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:22.813326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-2226e81f-4e40-4e64-b0f9-5bcab842d341 None None] MFA Rules not processed for user `0044e853972d4509a73ac07fa5934325`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:22.814525 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-2226e81f-4e40-4e64-b0f9-5bcab842d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:22.871919 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1295/2560] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:22.883678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:22.885347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:22.966397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1c22c-3e0b-484d-8871-a134da5639c9 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:22.972770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:22.973389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:22.973669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:22.973936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:22.982797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:22.984441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:22.993799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1266/2561] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:23.229529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226e81f-4e40-4e64-b0f9-5bcab842d341 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:23.290145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226e81f-4e40-4e64-b0f9-5bcab842d341 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:23.294510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a721d-2a93-4718-9a8a-1147c75ad2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:23.295154 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a721d-2a93-4718-9a8a-1147c75ad2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:23.295430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a721d-2a93-4718-9a8a-1147c75ad2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:23.295691 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a721d-2a93-4718-9a8a-1147c75ad2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:23.297895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-751a721d-2a93-4718-9a8a-1147c75ad2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:23.308990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a721d-2a93-4718-9a8a-1147c75ad2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:23.310426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a721d-2a93-4718-9a8a-1147c75ad2a6 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:23.314676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:23.319811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1296/2562] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:26.237862 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:26.250369 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2fc22-0c9e-47da-957f-29275b6037db service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:26.256757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:26.257932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:26.258211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:26.258559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:26.260478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:26.276384 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:26.278187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:26.293075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1267/2563] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:30.289210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:30.289719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:30.289719 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:30.310909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] MFA Rules not processed for user `1aff5c3ba252435fb64568ee34d2d986`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:30.312131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:30.378758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1297/2564] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:30.699864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:30.701626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:30.720913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d0728-7606-45f0-9a2f-b59d3f78942b service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:30.726967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:30.727783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:30.728139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:30.728471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:30.730246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:30.747786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:30.749495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:30.761632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1268/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:35.104988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:35.106572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:35.168731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aacc6-e8e6-495d-898d-e222722bc802 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:35.172486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:35.173103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:35.173384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:35.173656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:35.183275 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:35.184737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:35.194437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1298/2566] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:40.757457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=93 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:45.190072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=51 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:54.773254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:54.774734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:54.847262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80db4d-e5f8-4b05-9cc1-77f8098b2655 service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:54.853333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:54.854953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:54.855231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:54.855528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:54.859879 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:54.873256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:54.875052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:54.886424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1269/2567] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:55.334033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:55.348514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8f72f-0fdf-4a1b-9ea3-6ad89088f250 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:55.355088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:55.355973 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:55.356358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:55.356836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:55.358696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:55.371617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:55.373330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:55.383612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1299/2568] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:55.428072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:55.516265 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3caaa8-b6e4-4c88-9fd6-e03109a72498 service placement] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:55.523587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:55.524392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:55.524770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:55.525143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] PATH_INFO: `/v3/users/0044e853972d4509a73ac07fa5934325` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:55.526372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0044e853972d4509a73ac07fa5934325)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:55.528439 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:55.610239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0044e853972d4509a73ac07fa5934325'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:55.622311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0044e853972d4509a73ac07fa5934325'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:55.623285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0044e853972d4509a73ac07fa5934325'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:55.627624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0044e853972d4509a73ac07fa5934325'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:55.645463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0044e853972d4509a73ac07fa5934325'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:55.669563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1270/2569] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:04:55 2022] DELETE /identity/v3/users/0044e853972d4509a73ac07fa5934325 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:55.874262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:55.886169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437e94-bdef-40bf-a8d9-2cb456d5e7af service placement] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:55.952707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:55.953351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:55.953622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:55.953883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] PATH_INFO: `/v3/projects/4f42d652928a4521adcd1d52918a4228` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:55.955031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f42d652928a4521adcd1d52918a4228)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:55.956996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:56.006251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f42d652928a4521adcd1d52918a4228', 'request_id': 'req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.015486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f42d652928a4521adcd1d52918a4228', 'request_id': 'req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.021101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f42d652928a4521adcd1d52918a4228', 'request_id': 'req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.032725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] The token cache is being invalidate because project 4f42d652928a4521adcd1d52918a4228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:04:56.033011 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.033649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.035159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1300/2570] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:04:55 2022] DELETE /identity/v3/projects/4f42d652928a4521adcd1d52918a4228 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:56.039174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:56.040939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:56.055864 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dacc7-dffb-4734-ad1d-de00f2e3af08 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:56.061454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:56.121207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:56.121858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.122130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.122395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] PATH_INFO: `/v3/users/f3e8f4e76f3b4d2da93a334271339c5b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.123584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e8f4e76f3b4d2da93a334271339c5b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:56.125820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:56.184294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e8f4e76f3b4d2da93a334271339c5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.193655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e8f4e76f3b4d2da93a334271339c5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.194446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e8f4e76f3b4d2da93a334271339c5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.195066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e8f4e76f3b4d2da93a334271339c5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.206114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-8f881022-ff78-4037-b20f-ac31bbc4e3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e8f4e76f3b4d2da93a334271339c5b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.227350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1271/2571] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:04:56 2022] DELETE /identity/v3/users/f3e8f4e76f3b4d2da93a334271339c5b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:56.430153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:56.432437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:56.446382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee38fe-de4b-481a-867a-a5e3a1fe7af1 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:56.511078 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:56.511753 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.512031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.512291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] PATH_INFO: `/v3/projects/a86cfed5b7d44f55a01632469986bf34` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.513424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86cfed5b7d44f55a01632469986bf34)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:56.515390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:56.541897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:56.571400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86cfed5b7d44f55a01632469986bf34', 'request_id': 'req-b6c5579a-e328-4169-898d-61232613f3a3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.580666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86cfed5b7d44f55a01632469986bf34', 'request_id': 'req-b6c5579a-e328-4169-898d-61232613f3a3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.588661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86cfed5b7d44f55a01632469986bf34', 'request_id': 'req-b6c5579a-e328-4169-898d-61232613f3a3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.600398 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] The token cache is being invalidate because project a86cfed5b7d44f55a01632469986bf34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:04:56.600682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.601414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b6c5579a-e328-4169-898d-61232613f3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:56.603009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1301/2572] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:04:56 2022] DELETE /identity/v3/projects/a86cfed5b7d44f55a01632469986bf34 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:56.608066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f1615-2a29-4ca0-b5af-f871a50ff4c6 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.608357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f1615-2a29-4ca0-b5af-f871a50ff4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.608630 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f1615-2a29-4ca0-b5af-f871a50ff4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.629857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-f75f1615-2a29-4ca0-b5af-f871a50ff4c6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:56.631907 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f75f1615-2a29-4ca0-b5af-f871a50ff4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:56.720060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1272/2573] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:56.722452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a86f-f73a-435f-b705-47b8a43f4b0e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.722735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a86f-f73a-435f-b705-47b8a43f4b0e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.723003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a86f-f73a-435f-b705-47b8a43f4b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.749743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-1f34a86f-f73a-435f-b705-47b8a43f4b0e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:56.751089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-1f34a86f-f73a-435f-b705-47b8a43f4b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:56.759127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1302/2574] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:56.763752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f1615-2a29-4ca0-b5af-f871a50ff4c6 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:56.773659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f1615-2a29-4ca0-b5af-f871a50ff4c6 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:56.778172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:56.778783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.779113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.779389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.780087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:04:56.780390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:56.782035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:56.794273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1273/2575] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:04:56.798909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34a86f-f73a-435f-b705-47b8a43f4b0e None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:56.808314 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34a86f-f73a-435f-b705-47b8a43f4b0e None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:56.813662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:56.814284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.814559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.814823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.815457 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:56.817815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:56.849130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1303/2576] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:56 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:56.853485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:56.865213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b970079-9f4b-4bcc-ba89-b3b2ef638d14 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:56.878712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:56.934559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:56.935175 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.935449 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.935875 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.936530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:56.938519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:56.962866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1274/2577] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:56 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:04:56.967282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:56.978894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f61a69-f53e-44bc-8325-5e5defc9644d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:56.984220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:56.984853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:56.985122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:56.985387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:56.986022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:56.987827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:57.001484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1304/2578] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:57.002687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:57.013041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aab65-bc85-458f-ac16-0679f9ce2b5c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:57.018673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7536f-1982-42a5-8d88-084c2eaba516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:57.019288 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7536f-1982-42a5-8d88-084c2eaba516 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.019559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7536f-1982-42a5-8d88-084c2eaba516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.019846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7536f-1982-42a5-8d88-084c2eaba516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.020477 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7536f-1982-42a5-8d88-084c2eaba516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:57.022061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7536f-1982-42a5-8d88-084c2eaba516 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:57.033096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1275/2579] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:57.037534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:57.047798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ecdc-1a8e-4c09-b399-55cb8fd0f875 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:57.053532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:57.054184 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.054459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.054727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] PATH_INFO: `/v3/projects/55a6c6e2daa7410e86ad84c70db85e40/users/576e2e6ca45e432fa37fa4c6f91a72b0/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.069967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a6c6e2daa7410e86ad84c70db85e40, user_id=576e2e6ca45e432fa37fa4c6f91a72b0, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:57.072925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:57.087891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1305/2580] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:57 2022] PUT /identity/v3/projects/55a6c6e2daa7410e86ad84c70db85e40/users/576e2e6ca45e432fa37fa4c6f91a72b0/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:57.098742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5300e42-1bcf-4c7f-8e31-b6f868f95b87 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.099285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5300e42-1bcf-4c7f-8e31-b6f868f95b87 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.099285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5300e42-1bcf-4c7f-8e31-b6f868f95b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.128256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-c5300e42-1bcf-4c7f-8e31-b6f868f95b87 None None] MFA Rules not processed for user `576e2e6ca45e432fa37fa4c6f91a72b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:57.129471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c5300e42-1bcf-4c7f-8e31-b6f868f95b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:57.198910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1276/2581] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:57.210974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:57.213240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:57.276496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c866a-38b9-4b7f-80fa-f45f423e096a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:57.280438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c159d8-0be9-44c8-b9a8-7a50c633e8e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:57.281316 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c159d8-0be9-44c8-b9a8-7a50c633e8e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.281596 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c159d8-0be9-44c8-b9a8-7a50c633e8e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.281863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c159d8-0be9-44c8-b9a8-7a50c633e8e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.290473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c159d8-0be9-44c8-b9a8-7a50c633e8e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:57.291947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c159d8-0be9-44c8-b9a8-7a50c633e8e3 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:57.300909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1306/2582] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:57.320495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5300e42-1bcf-4c7f-8e31-b6f868f95b87 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:57.391146 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5300e42-1bcf-4c7f-8e31-b6f868f95b87 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:57.395860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:57.396496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.396767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.397032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] PATH_INFO: `/v3/users/576e2e6ca45e432fa37fa4c6f91a72b0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.398279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=576e2e6ca45e432fa37fa4c6f91a72b0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:57.400223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:57.435328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:57.463632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576e2e6ca45e432fa37fa4c6f91a72b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:57.472394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576e2e6ca45e432fa37fa4c6f91a72b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:57.473071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576e2e6ca45e432fa37fa4c6f91a72b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:57.473617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576e2e6ca45e432fa37fa4c6f91a72b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:57.480828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576e2e6ca45e432fa37fa4c6f91a72b0'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:57.498876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1277/2583] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:04:57 2022] DELETE /identity/v3/users/576e2e6ca45e432fa37fa4c6f91a72b0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:04:57.503534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.504060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.504167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.523863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:57.525054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:57.568879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:57.588716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1307/2584] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:57.599167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:57.600778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:57.660650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd760e77-0e75-406a-bfed-076037d56abd admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:57.664655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24474d1e-4307-4f1c-8e3c-34437a0af9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:57.665298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474d1e-4307-4f1c-8e3c-34437a0af9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.665573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474d1e-4307-4f1c-8e3c-34437a0af9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.665842 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474d1e-4307-4f1c-8e3c-34437a0af9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.675267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24474d1e-4307-4f1c-8e3c-34437a0af9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:57.676750 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24474d1e-4307-4f1c-8e3c-34437a0af9a7 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:57.686338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1278/2585] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:57.969953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:57.971498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:57.983533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38c385-a4b9-4c10-8ee5-1c2e16a609ae None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:57.988837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:57.989476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:57.989759 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:57.990023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] PATH_INFO: `/v3/projects/55a6c6e2daa7410e86ad84c70db85e40` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:57.991168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a6c6e2daa7410e86ad84c70db85e40)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:57.993124 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.041642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a6c6e2daa7410e86ad84c70db85e40', 'request_id': 'req-76a1371b-d687-4d8b-b2fa-3d4932529249'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:58.050923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a6c6e2daa7410e86ad84c70db85e40', 'request_id': 'req-76a1371b-d687-4d8b-b2fa-3d4932529249'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:58.060443 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a6c6e2daa7410e86ad84c70db85e40', 'request_id': 'req-76a1371b-d687-4d8b-b2fa-3d4932529249'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:58.078210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] The token cache is being invalidate because project 55a6c6e2daa7410e86ad84c70db85e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:04:58.078645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:58.079377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-76a1371b-d687-4d8b-b2fa-3d4932529249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:04:58.081033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1308/2586] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:04:57 2022] DELETE /identity/v3/projects/55a6c6e2daa7410e86ad84c70db85e40 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:58.087166 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c117e-5127-46c4-b2b1-e70d6696c99d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.087536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c117e-5127-46c4-b2b1-e70d6696c99d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.087844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c117e-5127-46c4-b2b1-e70d6696c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.115674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b10c117e-5127-46c4-b2b1-e70d6696c99d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:58.116927 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b10c117e-5127-46c4-b2b1-e70d6696c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:58.177542 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1279/2587] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:58.185622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e4cf5-ff1f-41f0-b369-32fc3fadc8b9 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.185903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e4cf5-ff1f-41f0-b369-32fc3fadc8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.186196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e4cf5-ff1f-41f0-b369-32fc3fadc8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.206622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4b9e4cf5-ff1f-41f0-b369-32fc3fadc8b9 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:58.208173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4b9e4cf5-ff1f-41f0-b369-32fc3fadc8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:58.217094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1309/2588] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:58.221567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c117e-5127-46c4-b2b1-e70d6696c99d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.231763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c117e-5127-46c4-b2b1-e70d6696c99d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.237115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.237713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.237987 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.238248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.238884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:04:58.239161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.240794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.253494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1280/2589] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:04:58.257756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e4cf5-ff1f-41f0-b369-32fc3fadc8b9 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.267072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e4cf5-ff1f-41f0-b369-32fc3fadc8b9 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.272367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.272965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.273269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.273527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.274143 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.276094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.307290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1310/2590] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:58 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:58.311597 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.321669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284132-7d49-4899-9b93-65b871b74738 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.353199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:58.380932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.381535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.381813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.382075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.382685 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.384645 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.408429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1281/2591] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:58 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:58.412636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.423293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb8a5-d08a-4308-9563-fe1c8856dd13 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.428009 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.428641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.428914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.429175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.429812 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.431405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.442162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1311/2592] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:58.446613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.461139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a81d0-fa49-402e-bbc9-1691f400149a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.467621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1261f12-3be4-44a5-85ad-4b7d2cb61946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.468295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261f12-3be4-44a5-85ad-4b7d2cb61946 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.468563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261f12-3be4-44a5-85ad-4b7d2cb61946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.468836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261f12-3be4-44a5-85ad-4b7d2cb61946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.469485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1261f12-3be4-44a5-85ad-4b7d2cb61946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.471131 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1261f12-3be4-44a5-85ad-4b7d2cb61946 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.481674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1282/2593] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:58.485922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.496317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ca6aa-3f0f-4bb2-86cc-cae9ca489643 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.501928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.502599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.503000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.503939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] PATH_INFO: `/v3/projects/22da16d9708c46d79a8f131f10988595/users/cca024c029ec4c5bb9d8aa445812494d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.520277 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22da16d9708c46d79a8f131f10988595, user_id=cca024c029ec4c5bb9d8aa445812494d, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.525064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.547785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1312/2594] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:58 2022] PUT /identity/v3/projects/22da16d9708c46d79a8f131f10988595/users/cca024c029ec4c5bb9d8aa445812494d/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:58.551423 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db960-8cdb-47a8-b0ac-9d76103cae3e None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.551724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db960-8cdb-47a8-b0ac-9d76103cae3e None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.552041 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db960-8cdb-47a8-b0ac-9d76103cae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.581966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-054db960-8cdb-47a8-b0ac-9d76103cae3e None None] MFA Rules not processed for user `cca024c029ec4c5bb9d8aa445812494d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:58.583565 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-054db960-8cdb-47a8-b0ac-9d76103cae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:58.652313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1283/2595] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:58.657663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.722783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3402d-7178-4c6b-95b1-f2802251f3b9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.728013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.728665 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.728939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.729201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.729948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.732123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.744604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:58.766895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1313/2596] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:58 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:58.768074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db960-8cdb-47a8-b0ac-9d76103cae3e None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.779248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db960-8cdb-47a8-b0ac-9d76103cae3e None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.842846 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.843769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.844068 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.844335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.844955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.846870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.868898 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1284/2597] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:58 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:04:58.873054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.883305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b930-db0d-4144-89c3-c1aec0c093b2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.887989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.888586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.888856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.889120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.889752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.891794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.901940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1314/2598] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:58.906006 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.916263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d947a8f-043b-4bdd-b65d-4b5f20f5edda admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.920852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f303-f2ee-4731-86ef-f9a39ce87383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.921624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f303-f2ee-4731-86ef-f9a39ce87383 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.921905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f303-f2ee-4731-86ef-f9a39ce87383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.922165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f303-f2ee-4731-86ef-f9a39ce87383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.922791 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5f303-f2ee-4731-86ef-f9a39ce87383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.924407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5f303-f2ee-4731-86ef-f9a39ce87383 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.934928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1285/2599] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:58.939142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:58.950194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067dce-66a1-4497-97d9-d22f1f6e93d9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:58.955925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:58.956614 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:58.956895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:58.957162 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] PATH_INFO: `/v3/projects/078d3ecd968f4c8493282c574f587305/users/8314f3f11f194ccdb3d063546189620b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:58.972760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078d3ecd968f4c8493282c574f587305, user_id=8314f3f11f194ccdb3d063546189620b, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:58.975420 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:58.997532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1315/2600] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:58 2022] PUT /identity/v3/projects/078d3ecd968f4c8493282c574f587305/users/8314f3f11f194ccdb3d063546189620b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:59.012969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb0ff-22b0-4277-9ed4-571b7de059a1 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.013374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb0ff-22b0-4277-9ed4-571b7de059a1 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.013701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb0ff-22b0-4277-9ed4-571b7de059a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.043836 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8b5fb0ff-22b0-4277-9ed4-571b7de059a1 None None] MFA Rules not processed for user `8314f3f11f194ccdb3d063546189620b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:59.045165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8b5fb0ff-22b0-4277-9ed4-571b7de059a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:59.055007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:59.115674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1286/2601] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:59.120363 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.189120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24c51e-3eab-4dda-ab7e-2be83ca95580 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.194284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.194889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.195192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.195456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.196111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.198026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.228805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1316/2602] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:04:59 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:59.233158 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb0ff-22b0-4277-9ed4-571b7de059a1 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.244495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb0ff-22b0-4277-9ed4-571b7de059a1 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.305174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.306014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.306424 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.306866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.307523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.309828 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.336270 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1287/2603] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:04:59 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:04:59.340327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.352007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebf35c-ee46-4aa9-99f9-4f9fe58ce906 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.357187 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.357787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.358062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.358331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.359001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.360664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.371581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1317/2604] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:59.376063 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.385995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bfe60-aab3-4ee6-aff0-285a1a49d2f4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.390948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.391594 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.391923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.392190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] PATH_INFO: `/v3/projects/713425b093c940d39df4ad4775ec6826/users/8947c1ad32d24b639a1501532043ceac/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.408735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=713425b093c940d39df4ad4775ec6826, user_id=8947c1ad32d24b639a1501532043ceac, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.411629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.432986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1288/2605] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:59 2022] PUT /identity/v3/projects/713425b093c940d39df4ad4775ec6826/users/8947c1ad32d24b639a1501532043ceac/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:59.437556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.447886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b21157-c29e-4e22-95df-22c13ed5900f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.510963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5426a-1d11-4ae9-8e1f-b767fc0cc2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.511772 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5426a-1d11-4ae9-8e1f-b767fc0cc2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.511888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5426a-1d11-4ae9-8e1f-b767fc0cc2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.512081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5426a-1d11-4ae9-8e1f-b767fc0cc2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.512708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5426a-1d11-4ae9-8e1f-b767fc0cc2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.514299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5426a-1d11-4ae9-8e1f-b767fc0cc2dd admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.524170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1318/2606] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:04:59.528731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.539626 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf298c8-e760-4be7-81b2-7ac50bafba9f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.544840 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.545494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.545769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.546053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] PATH_INFO: `/v3/projects/713425b093c940d39df4ad4775ec6826/users/8947c1ad32d24b639a1501532043ceac/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.548444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713425b093c940d39df4ad4775ec6826, user_id=8947c1ad32d24b639a1501532043ceac, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.551075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.562486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1289/2607] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:04:59 2022] PUT /identity/v3/projects/713425b093c940d39df4ad4775ec6826/users/8947c1ad32d24b639a1501532043ceac/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:04:59.578170 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.578446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.578709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.625058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] MFA Rules not processed for user `8947c1ad32d24b639a1501532043ceac`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:04:59.627365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:59.646703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:59.710586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1319/2608] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:04:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:04:59.723065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.724941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:59.787185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:04:59.788693 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:59.797178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfae9fc-29de-4c24-95c2-1a243a33e6a0 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.801741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.802364 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.802642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.802908 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.816078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:04:59.848842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7176e-4e22-446b-88ee-31ff4ab38f94 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:04:59.852571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:04:59.853195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:04:59.853471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:04:59.853739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:04:59.855488 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:04:59.863185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.864674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.873812 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1290/2609] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:04:59.919483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:04:59.920977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:04:59.931580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1320/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:01.447581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:01.449065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:01.461308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e850-e47f-408a-b658-47e044b3ef99 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:01.465021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:01.465633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:01.465905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:01.466174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:01.528025 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:01.529534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:01.539033 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1291/2611] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:02.178416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:02.190340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059880f-b006-41c4-ab12-32d240b3ee3f service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:02.194738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:02.195510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:02.195897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:02.196225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:02.207047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:02.209013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:02.223604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1321/2612] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:03.215845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:03.217431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:03.233669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931387b-8ebb-4678-aaed-e1798cbb78e9 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:03.238059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:03.238745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:03.239020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:03.239286 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] PATH_INFO: `/v3/users/e270bd406d644bf89649f40f66166430` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:03.240418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e270bd406d644bf89649f40f66166430)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:03.242368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:03.290563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e270bd406d644bf89649f40f66166430'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.299223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e270bd406d644bf89649f40f66166430'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.299852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e270bd406d644bf89649f40f66166430'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.300473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e270bd406d644bf89649f40f66166430'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.307757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-9727b7f4-9f82-476c-9c51-69df2013dc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e270bd406d644bf89649f40f66166430'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.325642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1292/2613] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:03 2022] DELETE /identity/v3/users/e270bd406d644bf89649f40f66166430 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:03.528000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:03.540098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f4c2b-4f51-46b1-8e85-398b477d1982 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:03.595625 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:03.609910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:03.610560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:03.610885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:03.611157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] PATH_INFO: `/v3/projects/d7b470dff8e048968bf8ffe9410f1092` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:03.612393 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b470dff8e048968bf8ffe9410f1092)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:03.614500 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:03.672427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b470dff8e048968bf8ffe9410f1092', 'request_id': 'req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.682874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b470dff8e048968bf8ffe9410f1092', 'request_id': 'req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.690640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b470dff8e048968bf8ffe9410f1092', 'request_id': 'req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.704034 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] The token cache is being invalidate because project d7b470dff8e048968bf8ffe9410f1092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:03.704326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.705040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e0ee6fe4-cfdd-41c1-be2a-353e3c719e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:03.706632 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1322/2614] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:03 2022] DELETE /identity/v3/projects/d7b470dff8e048968bf8ffe9410f1092 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:03.712018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff080-b6bb-4813-abe5-773e011da93c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:03.712350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff080-b6bb-4813-abe5-773e011da93c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:03.712627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff080-b6bb-4813-abe5-773e011da93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:03.734074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-29eff080-b6bb-4813-abe5-773e011da93c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:03.735365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-29eff080-b6bb-4813-abe5-773e011da93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:03.756752 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:03.797739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1293/2615] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:03.807646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71168a-50d4-441b-9010-3fe241565298 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:03.807646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71168a-50d4-441b-9010-3fe241565298 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:03.807935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71168a-50d4-441b-9010-3fe241565298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:03.830105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6d71168a-50d4-441b-9010-3fe241565298 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:03.831324 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6d71168a-50d4-441b-9010-3fe241565298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:03.840375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1323/2616] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:03.845239 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eff080-b6bb-4813-abe5-773e011da93c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:03.855996 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eff080-b6bb-4813-abe5-773e011da93c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:03.860959 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:03.861689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:03.861995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:03.862267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:03.862885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:05:03.863188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:03.864827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:03.879759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1294/2617] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:05:03.886006 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71168a-50d4-441b-9010-3fe241565298 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:03.900430 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71168a-50d4-441b-9010-3fe241565298 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:03.907247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:03.908048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:03.908401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:03.908740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:03.909560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:03.911822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:03.941841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1324/2618] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:03 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:03.946083 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:03.956485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2b973-32e4-4860-872c-62fd384dcd12 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.017592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.018198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.018475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.018741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.019385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.021328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.047821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1295/2619] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:03 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:05:04.052228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.062852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47cc9-b137-4d19-b197-d8b94ac1e5da admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.068671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.069289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.069580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.069963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.070990 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.073970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.085769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1325/2620] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:04.090140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.100391 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085347c7-1378-4496-8254-8f0d4d38a894 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.105256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d3ed-43ff-4b09-9c29-133b23bc7b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.105865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d3ed-43ff-4b09-9c29-133b23bc7b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.106139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d3ed-43ff-4b09-9c29-133b23bc7b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.106405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d3ed-43ff-4b09-9c29-133b23bc7b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.107021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74d3ed-43ff-4b09-9c29-133b23bc7b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.108637 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74d3ed-43ff-4b09-9c29-133b23bc7b97 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.119380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1296/2621] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:04.123669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.133890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45f84-9d8d-4cf8-b1f1-893b1c5623c7 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.139082 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.139726 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.140036 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.140362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] PATH_INFO: `/v3/projects/f5011e722e42482cbcc064a7c487d280/users/0b88182420194853955f49e14317048a/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.156105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5011e722e42482cbcc064a7c487d280, user_id=0b88182420194853955f49e14317048a, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.158796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.174636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1326/2622] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:04 2022] PUT /identity/v3/projects/f5011e722e42482cbcc064a7c487d280/users/0b88182420194853955f49e14317048a/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:04.185602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f117-4ce0-451f-a8e6-4418a3733576 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.185888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f117-4ce0-451f-a8e6-4418a3733576 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.186155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f117-4ce0-451f-a8e6-4418a3733576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.216929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9ee1f117-4ce0-451f-a8e6-4418a3733576 None None] MFA Rules not processed for user `0b88182420194853955f49e14317048a`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:04.218319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9ee1f117-4ce0-451f-a8e6-4418a3733576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:04.288759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1297/2623] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:04.294193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.375955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae39f3e-9daa-4c6f-91dc-21e4a30c6959 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.381181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.381783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.382057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.382320 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.382963 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.384889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.408580 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:04.415149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1327/2624] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:04 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:04.419576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1f117-4ce0-451f-a8e6-4418a3733576 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.430986 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1f117-4ce0-451f-a8e6-4418a3733576 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.449928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:04.493967 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.494578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.494861 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.495126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.495807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.497699 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.521758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1298/2625] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:04 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:04.525964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.536468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f1fe6-fe3e-4d7f-9bea-7a51d2ee2bce admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.541595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.542201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.542479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.542745 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.543384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.545055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.556027 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1328/2626] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:04.560219 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.571345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859df06d-8456-487d-9a06-9e39011121cd admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.577289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.578385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.578820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.579164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] PATH_INFO: `/v3/projects/5a96d32cb72e4a109e46ebc5ffcefba8/users/b3313935d9e141d1a5a1a875754b58bb/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.600743 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a96d32cb72e4a109e46ebc5ffcefba8, user_id=b3313935d9e141d1a5a1a875754b58bb, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.603399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.619183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1299/2627] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:04 2022] PUT /identity/v3/projects/5a96d32cb72e4a109e46ebc5ffcefba8/users/b3313935d9e141d1a5a1a875754b58bb/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:04.625088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.637684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111e72-e5ac-4a51-960f-9013552b43eb admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.705334 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431eb20-9add-457f-8334-2555dd42c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.705942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431eb20-9add-457f-8334-2555dd42c3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.706215 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431eb20-9add-457f-8334-2555dd42c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.706480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431eb20-9add-457f-8334-2555dd42c3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.707105 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431eb20-9add-457f-8334-2555dd42c3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.709072 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431eb20-9add-457f-8334-2555dd42c3cc admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.721469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1329/2628] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:04.725904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.736508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d11032-f77c-43c9-a844-40252249c48e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.741502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.742185 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.742420 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.742713 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] PATH_INFO: `/v3/projects/5a96d32cb72e4a109e46ebc5ffcefba8/users/b3313935d9e141d1a5a1a875754b58bb/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.744678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a96d32cb72e4a109e46ebc5ffcefba8, user_id=b3313935d9e141d1a5a1a875754b58bb, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.747279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.758307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1300/2629] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:04 2022] PUT /identity/v3/projects/5a96d32cb72e4a109e46ebc5ffcefba8/users/b3313935d9e141d1a5a1a875754b58bb/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:04.769435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f6dc-ec0d-488b-98cd-468753cdd4cc None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.769435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f6dc-ec0d-488b-98cd-468753cdd4cc None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.769636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8f6dc-ec0d-488b-98cd-468753cdd4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.797685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-47c8f6dc-ec0d-488b-98cd-468753cdd4cc None None] MFA Rules not processed for user `b3313935d9e141d1a5a1a875754b58bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:04.798888 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-47c8f6dc-ec0d-488b-98cd-468753cdd4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:04.879764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1330/2630] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:04.893481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:04.895326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:04.958100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf72a-9376-4345-bcce-c9e3ea2547ce admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:04.962164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:04.962817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:04.963075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:04.963343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:04.973303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:04.974734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:04.985199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1301/2631] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:05.042428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f6dc-ec0d-488b-98cd-468753cdd4cc None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:05.052491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8f6dc-ec0d-488b-98cd-468753cdd4cc None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:05.056360 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f791f63-eee2-45c6-9762-1cf101a17781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:05.056957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791f63-eee2-45c6-9762-1cf101a17781 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:05.057231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791f63-eee2-45c6-9762-1cf101a17781 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:05.057502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f791f63-eee2-45c6-9762-1cf101a17781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:05.260451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f791f63-eee2-45c6-9762-1cf101a17781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:05.261820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f791f63-eee2-45c6-9762-1cf101a17781 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:05.271370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1331/2632] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:06.236520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:06.238825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:06.314690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00506f-ac68-4dcc-ad11-5ac330dec437 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:06.319821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:06.320461 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:06.320760 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:06.321024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] PATH_INFO: `/v3/users/cca024c029ec4c5bb9d8aa445812494d` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:06.322192 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca024c029ec4c5bb9d8aa445812494d)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:06.324221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:06.345953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:06.377718 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca024c029ec4c5bb9d8aa445812494d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:06.389281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca024c029ec4c5bb9d8aa445812494d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:06.389937 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca024c029ec4c5bb9d8aa445812494d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:06.390627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca024c029ec4c5bb9d8aa445812494d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:06.398224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca024c029ec4c5bb9d8aa445812494d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:06.415426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1302/2633] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:06 2022] DELETE /identity/v3/users/cca024c029ec4c5bb9d8aa445812494d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:06.420028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:06.420513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:06.420513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:06.441024 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:06.442232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:06.446565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:06.505335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1332/2634] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:06.516488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:06.518122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:06.580968 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076b4e-cfce-4c84-9070-59fb56bf280e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:06.585994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:06.586989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:06.587262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:06.587523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:06.599048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:06.600521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:06.610574 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1303/2635] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:06.905073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:06.906850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:06.925474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58144b0-3f3d-44f1-97c5-7fe4f994ecd7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:06.931492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:06.932273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:06.932600 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:06.932852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] PATH_INFO: `/v3/projects/22da16d9708c46d79a8f131f10988595` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:06.934134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22da16d9708c46d79a8f131f10988595)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:06.936080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:06.988899 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22da16d9708c46d79a8f131f10988595', 'request_id': 'req-936e360c-59be-470c-9a42-ae3cba25522e'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:06.997103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22da16d9708c46d79a8f131f10988595', 'request_id': 'req-936e360c-59be-470c-9a42-ae3cba25522e'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.003717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22da16d9708c46d79a8f131f10988595', 'request_id': 'req-936e360c-59be-470c-9a42-ae3cba25522e'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.016512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] The token cache is being invalidate because project 22da16d9708c46d79a8f131f10988595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:07.016869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.023775 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.025535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1333/2636] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:06 2022] DELETE /identity/v3/projects/22da16d9708c46d79a8f131f10988595 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:07.029572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:07.041154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826132-b869-44bc-8acc-03a40ff38718 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:07.123333 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:07.124284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:07.124627 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:07.124958 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] PATH_INFO: `/v3/users/8314f3f11f194ccdb3d063546189620b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:07.126410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8314f3f11f194ccdb3d063546189620b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:07.128654 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:07.173712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:07.179409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8314f3f11f194ccdb3d063546189620b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.189514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8314f3f11f194ccdb3d063546189620b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.190116 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8314f3f11f194ccdb3d063546189620b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.190778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8314f3f11f194ccdb3d063546189620b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.198205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8314f3f11f194ccdb3d063546189620b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.216434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1304/2637] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:07 2022] DELETE /identity/v3/users/8314f3f11f194ccdb3d063546189620b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:07.507640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:07.509104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:07.523189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e360c-59be-470c-9a42-ae3cba25522e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:07.581586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:07.582565 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:07.582835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:07.583093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] PATH_INFO: `/v3/projects/078d3ecd968f4c8493282c574f587305` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:07.584250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078d3ecd968f4c8493282c574f587305)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:07.586194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:07.625483 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:07.635824 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078d3ecd968f4c8493282c574f587305', 'request_id': 'req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.646140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078d3ecd968f4c8493282c574f587305', 'request_id': 'req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.651935 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078d3ecd968f4c8493282c574f587305', 'request_id': 'req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.663168 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] The token cache is being invalidate because project 078d3ecd968f4c8493282c574f587305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:07.663456 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.664215 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.665790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1334/2638] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:07 2022] DELETE /identity/v3/projects/078d3ecd968f4c8493282c574f587305 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:07.669991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:07.671442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:07.684346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82634cf8-7ecb-4052-9180-316a4d898235 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:07.742501 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:07.743057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:07.743334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:07.743607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] PATH_INFO: `/v3/users/8947c1ad32d24b639a1501532043ceac` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:07.744890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8947c1ad32d24b639a1501532043ceac)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:07.746822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:07.800263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8947c1ad32d24b639a1501532043ceac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.809659 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8947c1ad32d24b639a1501532043ceac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.810389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8947c1ad32d24b639a1501532043ceac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.811090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8947c1ad32d24b639a1501532043ceac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.819050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-44d89618-cce8-4e82-9e9f-bf25f2f9c34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8947c1ad32d24b639a1501532043ceac'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:07.838285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1305/2639] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:07 2022] DELETE /identity/v3/users/8947c1ad32d24b639a1501532043ceac => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:08.129511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.131176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.154190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e32f5-7edf-4d14-8a3d-8a2d0bc42d37 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.218539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.219233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.219382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.219645 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] PATH_INFO: `/v3/projects/713425b093c940d39df4ad4775ec6826` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.220962 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713425b093c940d39df4ad4775ec6826)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.223052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.276251 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713425b093c940d39df4ad4775ec6826', 'request_id': 'req-db7478f8-efc2-4056-a6aa-364f23658b83'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.285546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713425b093c940d39df4ad4775ec6826', 'request_id': 'req-db7478f8-efc2-4056-a6aa-364f23658b83'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.291405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713425b093c940d39df4ad4775ec6826', 'request_id': 'req-db7478f8-efc2-4056-a6aa-364f23658b83'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.303144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] The token cache is being invalidate because project 713425b093c940d39df4ad4775ec6826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:08.303428 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.304147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-db7478f8-efc2-4056-a6aa-364f23658b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.305627 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1335/2640] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:08 2022] DELETE /identity/v3/projects/713425b093c940d39df4ad4775ec6826 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:08.310729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a5f6-1ed2-4839-a9c4-9da7c5a210bf None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.310915 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a5f6-1ed2-4839-a9c4-9da7c5a210bf None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.311191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5a5f6-1ed2-4839-a9c4-9da7c5a210bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.332081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d1d5a5f6-1ed2-4839-a9c4-9da7c5a210bf None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:08.333849 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d1d5a5f6-1ed2-4839-a9c4-9da7c5a210bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.371528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:08.402016 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1306/2641] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:08.410735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a3d4-1965-4c7e-9351-f826fcba0ef8 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.411073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a3d4-1965-4c7e-9351-f826fcba0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.411353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a3d4-1965-4c7e-9351-f826fcba0ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.431672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9726a3d4-1965-4c7e-9351-f826fcba0ef8 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:08.433292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9726a3d4-1965-4c7e-9351-f826fcba0ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.442158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1336/2642] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:08.446687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a5f6-1ed2-4839-a9c4-9da7c5a210bf None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.456866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5a5f6-1ed2-4839-a9c4-9da7c5a210bf None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.461847 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.462454 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.462839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.463107 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.463824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:05:08.464080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.465689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.481316 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1307/2643] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:05:08.482513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726a3d4-1965-4c7e-9351-f826fcba0ef8 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.495089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726a3d4-1965-4c7e-9351-f826fcba0ef8 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.500111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.500841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.501122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.501391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.502496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.504032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.536408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1337/2644] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:08 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:08.540690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.551215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2502e5-79c4-4d38-a83a-1519cdd55b9a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.613047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.613632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.613941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.614209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.614835 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.616788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.640294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1308/2645] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:08 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:08.644621 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.654636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6763b4a-8dc7-472a-87ec-564b8f516899 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.659669 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.660373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.660728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.661052 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.661749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.663386 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.673280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1338/2646] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:08.677783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.693267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407cf15-ce38-4e1c-bb5e-04c471693a25 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.698726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.699342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.699639 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.699945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.700587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.702182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.702847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.705045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.717887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bcc43-57fb-4ba9-a5fd-3ff7244be79b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.718271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1309/2647] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:08.718990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.722709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.723332 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.723601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.724111 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] PATH_INFO: `/v3/users/0b88182420194853955f49e14317048a` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.725257 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b88182420194853955f49e14317048a)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.727134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.728808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e8f4-ebd1-4651-8a99-23b4de830712 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.732730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:08.734164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ab521-21ec-4b76-aa05-f43cba400e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.735072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ab521-21ec-4b76-aa05-f43cba400e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.735383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ab521-21ec-4b76-aa05-f43cba400e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.735741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ab521-21ec-4b76-aa05-f43cba400e97 admin admin] PATH_INFO: `/v3/projects/ec6d0c76ac694ec1b474d62961dc1126/users/8bc60a5da2e94f82984d645637a40f73/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.751305 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ab521-21ec-4b76-aa05-f43cba400e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6d0c76ac694ec1b474d62961dc1126, user_id=8bc60a5da2e94f82984d645637a40f73, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.754343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ab521-21ec-4b76-aa05-f43cba400e97 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:08.768944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1310/2648] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:08 2022] PUT /identity/v3/projects/ec6d0c76ac694ec1b474d62961dc1126/users/8bc60a5da2e94f82984d645637a40f73/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:08.779436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.779749 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.780024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.781066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b88182420194853955f49e14317048a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.789385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b88182420194853955f49e14317048a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.796367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b88182420194853955f49e14317048a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.797055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b88182420194853955f49e14317048a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.809508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] MFA Rules not processed for user `8bc60a5da2e94f82984d645637a40f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:08.809797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-611a4d80-5dde-421a-8075-70d447f4d1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b88182420194853955f49e14317048a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:08.810729 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.817054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1339/2649] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:08 2022] DELETE /identity/v3/users/0b88182420194853955f49e14317048a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:08.821247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.821527 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.821798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.842405 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:08.843616 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.883664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1311/2650] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:05:08.895427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.896869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.907189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:08.908423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1340/2651] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:08.918688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:08.920084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:08.959408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c95f84-0712-4a64-aa9a-84c051092e52 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.976644 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23634-94ef-42fa-8c67-43b5a4f2534d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:08.980205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:08.980813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:08.981086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:08.981352 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:08.990487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:08.991949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:09.001339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1341/2652] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:05:09.009284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:09.009901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:09.010178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:09.010448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:09.070311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:09.071806 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:09.081188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1312/2653] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:09.291228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:09.292967 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:09.313465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486923-4433-4a85-b41b-f20bfaaddda3 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:09.320108 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:09.321029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:09.321448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:09.321783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] PATH_INFO: `/v3/projects/f5011e722e42482cbcc064a7c487d280` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:09.322781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5011e722e42482cbcc064a7c487d280)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:09.325816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:09.353296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:09.382604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5011e722e42482cbcc064a7c487d280', 'request_id': 'req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.394717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5011e722e42482cbcc064a7c487d280', 'request_id': 'req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.412101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5011e722e42482cbcc064a7c487d280', 'request_id': 'req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.423813 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] The token cache is being invalidate because project f5011e722e42482cbcc064a7c487d280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:09.424183 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.424981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.426920 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1342/2654] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:09 2022] DELETE /identity/v3/projects/f5011e722e42482cbcc064a7c487d280 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:09.430990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:09.442576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2023253-9721-411f-9377-35de0f9c3948 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:09.501554 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:09.502184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:09.502455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:09.502717 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] PATH_INFO: `/v3/users/b3313935d9e141d1a5a1a875754b58bb` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:09.503952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3313935d9e141d1a5a1a875754b58bb)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:09.505918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:09.527936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:09.559069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3313935d9e141d1a5a1a875754b58bb'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.567874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3313935d9e141d1a5a1a875754b58bb'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.568562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3313935d9e141d1a5a1a875754b58bb'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.569176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3313935d9e141d1a5a1a875754b58bb'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.576161 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3583eb95-89a8-45b5-83d2-dcaa837e3021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3313935d9e141d1a5a1a875754b58bb'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:09.597881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1313/2655] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:09 2022] DELETE /identity/v3/users/b3313935d9e141d1a5a1a875754b58bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:09.889422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:09.891047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:09.904796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a54e-0d4f-4870-8b46-abd3d59c1fce admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:09.964131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:09.964768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:09.965051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:09.965306 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] PATH_INFO: `/v3/projects/5a96d32cb72e4a109e46ebc5ffcefba8` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:09.966426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a96d32cb72e4a109e46ebc5ffcefba8)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:09.968370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.023318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a96d32cb72e4a109e46ebc5ffcefba8', 'request_id': 'req-cfbcfcec-2a02-45eb-a230-67e30622b5a8'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:10.032209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a96d32cb72e4a109e46ebc5ffcefba8', 'request_id': 'req-cfbcfcec-2a02-45eb-a230-67e30622b5a8'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:10.038021 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a96d32cb72e4a109e46ebc5ffcefba8', 'request_id': 'req-cfbcfcec-2a02-45eb-a230-67e30622b5a8'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:10.049122 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] The token cache is being invalidate because project 5a96d32cb72e4a109e46ebc5ffcefba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:10.049401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:10.050067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-cfbcfcec-2a02-45eb-a230-67e30622b5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:10.051589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1343/2656] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:09 2022] DELETE /identity/v3/projects/5a96d32cb72e4a109e46ebc5ffcefba8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:10.056633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f5e4-71aa-483b-9e00-e7dbeeab7e1a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.057151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f5e4-71aa-483b-9e00-e7dbeeab7e1a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.057247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345f5e4-71aa-483b-9e00-e7dbeeab7e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.077697 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-7345f5e4-71aa-483b-9e00-e7dbeeab7e1a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:10.078820 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-7345f5e4-71aa-483b-9e00-e7dbeeab7e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:10.142495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1314/2657] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:10.150817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09d55f-eb0d-4e78-bce3-db3e9e42a649 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.151098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09d55f-eb0d-4e78-bce3-db3e9e42a649 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.151362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09d55f-eb0d-4e78-bce3-db3e9e42a649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.171357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-8f09d55f-eb0d-4e78-bce3-db3e9e42a649 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:10.172578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8f09d55f-eb0d-4e78-bce3-db3e9e42a649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:10.181558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1344/2658] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:10.186200 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f5e4-71aa-483b-9e00-e7dbeeab7e1a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.201904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345f5e4-71aa-483b-9e00-e7dbeeab7e1a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.209771 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.210376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.210617 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.210901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.211536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:05:10.211871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.213553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.225710 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1315/2659] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:05:10.230164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09d55f-eb0d-4e78-bce3-db3e9e42a649 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.239278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09d55f-eb0d-4e78-bce3-db3e9e42a649 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.243940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.244533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.244801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.245061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.245682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.247568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.275649 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1345/2660] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:10 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:05:10.280070 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.291001 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fe164-714a-42d7-bee9-ee5c7f5f2f99 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.352360 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.352979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.353261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.353525 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.354151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.356154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.381649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1316/2661] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:10 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:10.386037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.398573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435a0b8-5036-4fb9-b43f-1cf1c84163ad admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.403335 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.403985 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.404263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.404533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.405172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.406765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.420149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1346/2662] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:10.421575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.439643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94244-7bfb-44a2-b982-6ee813676db9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.442905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e93860-a5fc-45dc-bf9f-843b7adcf318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.443560 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93860-a5fc-45dc-bf9f-843b7adcf318 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.443869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93860-a5fc-45dc-bf9f-843b7adcf318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.444138 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93860-a5fc-45dc-bf9f-843b7adcf318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.444788 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e93860-a5fc-45dc-bf9f-843b7adcf318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.446380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e93860-a5fc-45dc-bf9f-843b7adcf318 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.457772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1317/2663] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:10.461977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.467285 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:10.473369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bb392-b6fe-4f3a-9cb2-16d06d592f42 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.479237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.480299 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.480663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.480960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] PATH_INFO: `/v3/projects/f9290de9fa5b4ff4bdc06733aa0e77c7/users/8e25bef0b58048c9b43f5253ec47f718/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.496225 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9290de9fa5b4ff4bdc06733aa0e77c7, user_id=8e25bef0b58048c9b43f5253ec47f718, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.498921 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.513070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1347/2664] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:10 2022] PUT /identity/v3/projects/f9290de9fa5b4ff4bdc06733aa0e77c7/users/8e25bef0b58048c9b43f5253ec47f718/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:10.523960 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286cfa4-42c8-42cb-a371-caee270224ac None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.524313 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286cfa4-42c8-42cb-a371-caee270224ac None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.524660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286cfa4-42c8-42cb-a371-caee270224ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.535936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:10.556416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3286cfa4-42c8-42cb-a371-caee270224ac None None] MFA Rules not processed for user `8e25bef0b58048c9b43f5253ec47f718`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:10.557789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3286cfa4-42c8-42cb-a371-caee270224ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:10.627213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1318/2665] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:10.632088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.702755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c9317-fe97-4553-ba2c-e2b12d57b8ad admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.708516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.709176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.709471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.709743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.710371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.712458 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.742359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1348/2666] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:10 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:10.746896 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286cfa4-42c8-42cb-a371-caee270224ac None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.757944 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286cfa4-42c8-42cb-a371-caee270224ac None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.819365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.820003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.820276 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.820541 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.821179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.823096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.853018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1319/2667] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:10 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:05:10.854702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.866094 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f577a85-56f5-4e5e-a014-c44a4a85f88d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.871043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.871608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.871910 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.872189 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.872827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.874471 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.887136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1349/2668] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:10.891336 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.903252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a72c3-63e7-44bb-a78c-7025b929364f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.912085 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89b929-1381-4ef5-89c3-7f8c3c7df09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.912988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89b929-1381-4ef5-89c3-7f8c3c7df09d admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.913326 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89b929-1381-4ef5-89c3-7f8c3c7df09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.913668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89b929-1381-4ef5-89c3-7f8c3c7df09d admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.914629 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89b929-1381-4ef5-89c3-7f8c3c7df09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.916939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89b929-1381-4ef5-89c3-7f8c3c7df09d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.930190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1320/2669] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:10.936542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:10.951445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f707a01-56cb-4373-8843-f2e85ff607f9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:10.959336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:10.960077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:10.960350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:10.960618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] PATH_INFO: `/v3/projects/475147194be340fe924c8785c5e9ac78/users/ba0beb9220ed4bff8cfc57775d1a168b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:10.976408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475147194be340fe924c8785c5e9ac78, user_id=ba0beb9220ed4bff8cfc57775d1a168b, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:10.979298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:10.994291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1350/2670] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:10 2022] PUT /identity/v3/projects/475147194be340fe924c8785c5e9ac78/users/ba0beb9220ed4bff8cfc57775d1a168b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:11.005802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b379-e62a-482e-a611-e1d540641f6d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.006112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b379-e62a-482e-a611-e1d540641f6d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.006383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b379-e62a-482e-a611-e1d540641f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.034903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0a10b379-e62a-482e-a611-e1d540641f6d None None] MFA Rules not processed for user `ba0beb9220ed4bff8cfc57775d1a168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:11.036156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0a10b379-e62a-482e-a611-e1d540641f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:11.103656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1321/2671] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:11.108548 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.171140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e36e-e2c6-4d1f-b9b7-17934dc4ba53 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.176205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.176804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.177080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.177340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.177992 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.179897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.217906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1351/2672] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:11 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:11.222739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10b379-e62a-482e-a611-e1d540641f6d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.231134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:11.239459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10b379-e62a-482e-a611-e1d540641f6d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.301229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.301845 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.302124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.302504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.303154 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.305127 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.328784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1322/2673] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:11 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:11.333611 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.344852 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16558041-e13c-4a00-8e32-1a21520dd90b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.350056 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.350684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.350927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.351218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.351911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.353516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.365032 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1352/2674] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:11.369655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.381278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873092d-3665-4280-8a40-9aae9ad03229 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.386399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.387064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.387340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.387611 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] PATH_INFO: `/v3/projects/ead6997c548b4e5a8436299d5f389c71/users/d34885e09d974ba18d5d06e05db3de2d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.402614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead6997c548b4e5a8436299d5f389c71, user_id=d34885e09d974ba18d5d06e05db3de2d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.405291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.420827 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1323/2675] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:11 2022] PUT /identity/v3/projects/ead6997c548b4e5a8436299d5f389c71/users/d34885e09d974ba18d5d06e05db3de2d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:11.425473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.430509 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:11.442353 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d995842-70ee-4038-b7a5-e1c3a7e853c7 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.503660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16757b-41a6-482c-9e93-11e43e75b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.504298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16757b-41a6-482c-9e93-11e43e75b72a admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.504573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16757b-41a6-482c-9e93-11e43e75b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.504841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16757b-41a6-482c-9e93-11e43e75b72a admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.505473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16757b-41a6-482c-9e93-11e43e75b72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.507064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16757b-41a6-482c-9e93-11e43e75b72a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.517061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1353/2676] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:11.522113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.532822 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875d4c3-4e1c-4b09-a4f5-8e73cf53da8b admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.538325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.538974 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.539246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.539511 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] PATH_INFO: `/v3/projects/ead6997c548b4e5a8436299d5f389c71/users/d34885e09d974ba18d5d06e05db3de2d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.541520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead6997c548b4e5a8436299d5f389c71, user_id=d34885e09d974ba18d5d06e05db3de2d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.544187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.555223 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1324/2677] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:11 2022] PUT /identity/v3/projects/ead6997c548b4e5a8436299d5f389c71/users/d34885e09d974ba18d5d06e05db3de2d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:11.565722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.566342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.566612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.596551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] MFA Rules not processed for user `d34885e09d974ba18d5d06e05db3de2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:11.597977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:11.667317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1354/2678] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:11.672465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.674389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:11.679167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.680733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:11.736629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81475bc3-cacf-41db-8550-1cb8dd988c64 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.740949 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c242e4-736a-4c48-b0db-8ad10f10bc44 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:11.744538 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bb08b-caa4-4829-ab0e-d4e302a3c0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.745182 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bb08b-caa4-4829-ab0e-d4e302a3c0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.745455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bb08b-caa4-4829-ab0e-d4e302a3c0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.745563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:11.745705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bb08b-caa4-4829-ab0e-d4e302a3c0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.746136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.746508 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.746770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] PATH_INFO: `/v3/users/8bc60a5da2e94f82984d645637a40f73` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.747946 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc60a5da2e94f82984d645637a40f73)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.749860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.755922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bb08b-caa4-4829-ab0e-d4e302a3c0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:11.757347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bb08b-caa4-4829-ab0e-d4e302a3c0e6 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:11.767938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1355/2679] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:11.807353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc60a5da2e94f82984d645637a40f73'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:11.816613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc60a5da2e94f82984d645637a40f73'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:11.817244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc60a5da2e94f82984d645637a40f73'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:11.817912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc60a5da2e94f82984d645637a40f73'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:11.820397 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:11.828441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc60a5da2e94f82984d645637a40f73'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:11.847677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1325/2680] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:11 2022] DELETE /identity/v3/users/8bc60a5da2e94f82984d645637a40f73 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:11.852300 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563926-8ff1-405d-976d-a1748072498e None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:11.852685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563926-8ff1-405d-976d-a1748072498e None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:11.853061 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f563926-8ff1-405d-976d-a1748072498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:11.872974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-9f563926-8ff1-405d-976d-a1748072498e None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:11.874240 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9f563926-8ff1-405d-976d-a1748072498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:11.894818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:11.939413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1356/2681] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:11.950547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:11.952442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:12.017638 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d58e7a-5f36-4e2f-8cd9-06cee144d9b9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:12.022176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:12.022814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:12.023088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:12.023354 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:12.032677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:12.034348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:12.044198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1326/2682] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:12.304171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f563926-8ff1-405d-976d-a1748072498e None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:12.305672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9f563926-8ff1-405d-976d-a1748072498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:12.314523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:12.316368 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:12.330957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9efb-ddde-4514-893d-cfc808db2b18 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:12.336825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:12.337614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:12.337985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:12.338343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] PATH_INFO: `/v3/projects/ec6d0c76ac694ec1b474d62961dc1126` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:12.339585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6d0c76ac694ec1b474d62961dc1126)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:12.341610 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:12.369816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f563926-8ff1-405d-976d-a1748072498e None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:12.373805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:12.374479 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:12.374757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:12.375081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:12.376942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:12.391843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6d0c76ac694ec1b474d62961dc1126', 'request_id': 'req-00cc6509-6ffa-41a6-8141-02079bbf8ff7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:12.401495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6d0c76ac694ec1b474d62961dc1126', 'request_id': 'req-00cc6509-6ffa-41a6-8141-02079bbf8ff7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:12.410775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6d0c76ac694ec1b474d62961dc1126', 'request_id': 'req-00cc6509-6ffa-41a6-8141-02079bbf8ff7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:12.424783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] The token cache is being invalidate because project ec6d0c76ac694ec1b474d62961dc1126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:12.425516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:12.425913 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:12.442252 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1327/2683] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:12 2022] DELETE /identity/v3/projects/ec6d0c76ac694ec1b474d62961dc1126 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:12.452811 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:12.454221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:12.466301 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1357/2684] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:16.613661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:16.615758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:16.673196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc6509-6ffa-41a6-8141-02079bbf8ff7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:16.677318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9b609-85da-4a3a-9a2f-1d98b73a2fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:16.677929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b609-85da-4a3a-9a2f-1d98b73a2fcc service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:16.678206 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b609-85da-4a3a-9a2f-1d98b73a2fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:16.678473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b609-85da-4a3a-9a2f-1d98b73a2fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:16.680359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-25f9b609-85da-4a3a-9a2f-1d98b73a2fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:16.695370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:16.745803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9b609-85da-4a3a-9a2f-1d98b73a2fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:16.747231 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9b609-85da-4a3a-9a2f-1d98b73a2fcc service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:16.756117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1328/2685] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:18.926573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:18.928173 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:18.941712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d49db-f0f6-4740-aa96-679daf9c21bb service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:19.002195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:19.003104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:19.003104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:19.003351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] PATH_INFO: `/v3/users/8e25bef0b58048c9b43f5253ec47f718` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:19.004608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e25bef0b58048c9b43f5253ec47f718)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:19.006536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:19.033391 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:19.060708 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e25bef0b58048c9b43f5253ec47f718'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.070014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e25bef0b58048c9b43f5253ec47f718'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.077265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e25bef0b58048c9b43f5253ec47f718'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.077903 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e25bef0b58048c9b43f5253ec47f718'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.096582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e25bef0b58048c9b43f5253ec47f718'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.104760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1358/2686] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:18 2022] DELETE /identity/v3/users/8e25bef0b58048c9b43f5253ec47f718 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:19.109505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:19.110032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:19.110032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:19.135547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:19.136794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:19.227026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1329/2687] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:19.244186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:19.245796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:19.311983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f74ce-7f89-416c-93db-e3b5f095d716 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:19.316235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:19.316853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:19.317128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:19.317392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:19.330399 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:19.332918 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:19.347618 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1359/2688] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:05:19.689539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:19.691115 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:19.711374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99286dc-185d-4c06-829d-ffd2019a8512 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:19.717882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:19.718641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:19.719173 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:19.719607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] PATH_INFO: `/v3/projects/f9290de9fa5b4ff4bdc06733aa0e77c7` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:19.724129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9290de9fa5b4ff4bdc06733aa0e77c7)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:19.724129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:19.783470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9290de9fa5b4ff4bdc06733aa0e77c7', 'request_id': 'req-63bb4801-6a07-4682-af4e-2ed0699138ae'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.794295 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9290de9fa5b4ff4bdc06733aa0e77c7', 'request_id': 'req-63bb4801-6a07-4682-af4e-2ed0699138ae'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.802365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9290de9fa5b4ff4bdc06733aa0e77c7', 'request_id': 'req-63bb4801-6a07-4682-af4e-2ed0699138ae'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.818762 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] The token cache is being invalidate because project f9290de9fa5b4ff4bdc06733aa0e77c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:19.819047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.819838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.821539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1330/2689] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:19 2022] DELETE /identity/v3/projects/f9290de9fa5b4ff4bdc06733aa0e77c7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:19.825765 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:19.838553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c676ffe-1b8b-4fe3-80f6-9c26b9d4eb12 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:19.913559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:19.914322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:19.914656 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:19.914987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] PATH_INFO: `/v3/users/ba0beb9220ed4bff8cfc57775d1a168b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:19.916263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0beb9220ed4bff8cfc57775d1a168b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:19.918604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:19.981643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:19.983869 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0beb9220ed4bff8cfc57775d1a168b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:19.994666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0beb9220ed4bff8cfc57775d1a168b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.004777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0beb9220ed4bff8cfc57775d1a168b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.005505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0beb9220ed4bff8cfc57775d1a168b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.018901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0beb9220ed4bff8cfc57775d1a168b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.025942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1360/2690] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:19 2022] DELETE /identity/v3/users/ba0beb9220ed4bff8cfc57775d1a168b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:20.322323 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:20.323881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:20.338695 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb4801-6a07-4682-af4e-2ed0699138ae admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:20.378770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:20.404703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:20.405284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:20.405561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:20.405829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] PATH_INFO: `/v3/projects/475147194be340fe924c8785c5e9ac78` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:20.406964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=475147194be340fe924c8785c5e9ac78)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:20.409071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:20.460852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475147194be340fe924c8785c5e9ac78', 'request_id': 'req-715c6837-0786-4333-b6c3-0c74ef7bbb2c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.469301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475147194be340fe924c8785c5e9ac78', 'request_id': 'req-715c6837-0786-4333-b6c3-0c74ef7bbb2c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.475679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475147194be340fe924c8785c5e9ac78', 'request_id': 'req-715c6837-0786-4333-b6c3-0c74ef7bbb2c'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.489553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] The token cache is being invalidate because project 475147194be340fe924c8785c5e9ac78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:20.489839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.490669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.492585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1331/2691] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:20 2022] DELETE /identity/v3/projects/475147194be340fe924c8785c5e9ac78 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:20.496490 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:20.508256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:20.522970 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d945478-a7dc-49f9-bef8-fe4f3cd63786 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:20.591271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:20.591966 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:20.592245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:20.592651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] PATH_INFO: `/v3/users/d34885e09d974ba18d5d06e05db3de2d` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:20.593794 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34885e09d974ba18d5d06e05db3de2d)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:20.595785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:20.661343 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34885e09d974ba18d5d06e05db3de2d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.678134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34885e09d974ba18d5d06e05db3de2d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.690088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34885e09d974ba18d5d06e05db3de2d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.690859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34885e09d974ba18d5d06e05db3de2d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.709414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-87dfd503-d814-4047-bc7f-329fc30d9e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34885e09d974ba18d5d06e05db3de2d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:20.717722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1361/2692] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:20 2022] DELETE /identity/v3/users/d34885e09d974ba18d5d06e05db3de2d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:21.030608 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.032303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:21.048779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c6837-0786-4333-b6c3-0c74ef7bbb2c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.114433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.115212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.115623 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.115989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] PATH_INFO: `/v3/projects/ead6997c548b4e5a8436299d5f389c71` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.117444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead6997c548b4e5a8436299d5f389c71)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.119490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.184014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead6997c548b4e5a8436299d5f389c71', 'request_id': 'req-26abc6ae-687f-474f-bcee-464681cf805e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:21.199964 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead6997c548b4e5a8436299d5f389c71', 'request_id': 'req-26abc6ae-687f-474f-bcee-464681cf805e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:21.207993 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead6997c548b4e5a8436299d5f389c71', 'request_id': 'req-26abc6ae-687f-474f-bcee-464681cf805e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:21.219411 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:21.225278 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] The token cache is being invalidate because project ead6997c548b4e5a8436299d5f389c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:21.225589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:21.226243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-26abc6ae-687f-474f-bcee-464681cf805e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:21.228112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1332/2693] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:21 2022] DELETE /identity/v3/projects/ead6997c548b4e5a8436299d5f389c71 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:21.233849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81be8-bd0b-4ff8-802e-ee9e11b7547c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.234377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81be8-bd0b-4ff8-802e-ee9e11b7547c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.234377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81be8-bd0b-4ff8-802e-ee9e11b7547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.254144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-0bc81be8-bd0b-4ff8-802e-ee9e11b7547c None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:21.255366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0bc81be8-bd0b-4ff8-802e-ee9e11b7547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:21.293881 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:21.318735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1362/2694] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:21.326310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fad45-ff3e-4c17-aaeb-249196f2fc02 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.326860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fad45-ff3e-4c17-aaeb-249196f2fc02 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.326860 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fad45-ff3e-4c17-aaeb-249196f2fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.348134 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b34fad45-ff3e-4c17-aaeb-249196f2fc02 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:21.349652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b34fad45-ff3e-4c17-aaeb-249196f2fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:21.358492 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1333/2695] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:21.362773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81be8-bd0b-4ff8-802e-ee9e11b7547c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.373220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81be8-bd0b-4ff8-802e-ee9e11b7547c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.378384 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.379102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.379381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.379654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.380323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:05:21.380672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.382407 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.394402 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1363/2696] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:05:21.398979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fad45-ff3e-4c17-aaeb-249196f2fc02 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.408343 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fad45-ff3e-4c17-aaeb-249196f2fc02 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.413264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.414179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.414466 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.414726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.415363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.417298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.454096 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1334/2697] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:21 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:21.458934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.473326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f7f5a-f07c-4e3e-8b6e-a735e0b5f5aa admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.532987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.533612 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.533889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.534158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.534795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.536777 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.560574 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1364/2698] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:21 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:05:21.564548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.575815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196657ce-83b2-4e88-b3d1-6601b70abbe7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.580635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.581255 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.581870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.582273 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.582923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.584719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.596514 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1335/2699] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:21.600841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.611492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebd64b-d477-4c05-8b25-b120848bc19a admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.616780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ded2a-6acd-4d7c-b658-6706f909e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.617422 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ded2a-6acd-4d7c-b658-6706f909e088 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.617700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ded2a-6acd-4d7c-b658-6706f909e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.617964 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ded2a-6acd-4d7c-b658-6706f909e088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.618610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ded2a-6acd-4d7c-b658-6706f909e088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.620248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ded2a-6acd-4d7c-b658-6706f909e088 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.631757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1365/2700] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:21.636031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.646438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c487e-7513-4b1c-9529-0185d9aa831e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.651401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.652111 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.652395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.652667 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] PATH_INFO: `/v3/projects/881ac36000da4594a53e574ede049d69/users/5bb8c6a2929d4f22a9f6c1b273ca2f06/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.668939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881ac36000da4594a53e574ede049d69, user_id=5bb8c6a2929d4f22a9f6c1b273ca2f06, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.671663 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.694857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1336/2701] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:21 2022] PUT /identity/v3/projects/881ac36000da4594a53e574ede049d69/users/5bb8c6a2929d4f22a9f6c1b273ca2f06/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:21.707373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ac58-ee84-4faa-a8e2-482b5b7b640c None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.707658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ac58-ee84-4faa-a8e2-482b5b7b640c None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.707959 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54ac58-ee84-4faa-a8e2-482b5b7b640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.736278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-ad54ac58-ee84-4faa-a8e2-482b5b7b640c None None] MFA Rules not processed for user `5bb8c6a2929d4f22a9f6c1b273ca2f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:21.737502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-ad54ac58-ee84-4faa-a8e2-482b5b7b640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:21.809447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1366/2702] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:21.814133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.881029 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dc51-a8b8-4dea-a00b-ef22510a9e40 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.883378 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.884018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.884260 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.884562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.885243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.887243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:21.917395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1337/2703] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:21 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:21.921271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ac58-ee84-4faa-a8e2-482b5b7b640c None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:21.931925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54ac58-ee84-4faa-a8e2-482b5b7b640c None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:21.967877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:21.993054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:21.993702 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:21.993977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:21.994243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:21.994886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:21.996832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:22.020863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1367/2704] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:21 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:22.024984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:22.036230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f111d-be35-48b2-af53-85cb223b4904 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:22.041236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:22.041882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:22.042179 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:22.042489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:22.043195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:22.044911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:22.058549 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1338/2705] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:22.062695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:22.089112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf48e-9f3f-4e24-bd26-720c4f3dcafb admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:22.095427 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:22.096231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:22.096566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:22.096891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] PATH_INFO: `/v3/projects/924ae97b588a4712b1fd9048250453f9/users/2743d08557ad412794e3b4657bec1f0b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:22.113239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924ae97b588a4712b1fd9048250453f9, user_id=2743d08557ad412794e3b4657bec1f0b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:22.116733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:22.131603 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1368/2706] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:22 2022] PUT /identity/v3/projects/924ae97b588a4712b1fd9048250453f9/users/2743d08557ad412794e3b4657bec1f0b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:22.135948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:22.146218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28959f9-a2bc-45f4-a531-b51bcd22b500 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:22.208441 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa0ff-e16c-402e-b314-5954f4ae49c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:22.209117 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa0ff-e16c-402e-b314-5954f4ae49c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:22.209408 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa0ff-e16c-402e-b314-5954f4ae49c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:22.209681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa0ff-e16c-402e-b314-5954f4ae49c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:22.210421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa0ff-e16c-402e-b314-5954f4ae49c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:22.212077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa0ff-e16c-402e-b314-5954f4ae49c1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:22.224548 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1339/2707] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:05:22.229012 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:22.240331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d48cc-af4a-421d-8789-616090a3e028 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:22.245841 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:22.246517 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:22.246787 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:22.247051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] PATH_INFO: `/v3/projects/924ae97b588a4712b1fd9048250453f9/users/2743d08557ad412794e3b4657bec1f0b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:22.248951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=924ae97b588a4712b1fd9048250453f9, user_id=2743d08557ad412794e3b4657bec1f0b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:22.251631 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:22.262643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1369/2708] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:22 2022] PUT /identity/v3/projects/924ae97b588a4712b1fd9048250453f9/users/2743d08557ad412794e3b4657bec1f0b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:22.273040 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481ff73-68a8-4428-a0a2-10cdf9fbda24 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:22.273352 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481ff73-68a8-4428-a0a2-10cdf9fbda24 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:22.273652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481ff73-68a8-4428-a0a2-10cdf9fbda24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:22.283045 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:22.305942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d481ff73-68a8-4428-a0a2-10cdf9fbda24 None None] MFA Rules not processed for user `2743d08557ad412794e3b4657bec1f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:22.307255 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d481ff73-68a8-4428-a0a2-10cdf9fbda24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:22.377079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1340/2709] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:22.388572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:22.390273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:22.460062 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aa76a-e83e-44dd-9a8d-c3d13d15be0d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:22.465949 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:22.466988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:22.467476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:22.467995 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:22.484220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:22.488725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:22.506997 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1370/2710] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:22.620578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481ff73-68a8-4428-a0a2-10cdf9fbda24 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:22.632135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481ff73-68a8-4428-a0a2-10cdf9fbda24 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:22.636114 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ce17f-9e4c-4411-a73a-e09ca370c6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:22.636723 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ce17f-9e4c-4411-a73a-e09ca370c6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:22.636994 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ce17f-9e4c-4411-a73a-e09ca370c6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:22.637256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ce17f-9e4c-4411-a73a-e09ca370c6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:22.698804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ce17f-9e4c-4411-a73a-e09ca370c6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:22.700390 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ce17f-9e4c-4411-a73a-e09ca370c6d5 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:22.710050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1341/2711] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:25.356732 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:25.425948 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624174b2-13be-47d6-99a5-6103c3266a61 service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:25.432247 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:25.432890 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:25.433163 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:25.433424 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] PATH_INFO: `/v3/users/5bb8c6a2929d4f22a9f6c1b273ca2f06` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:25.434562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb8c6a2929d4f22a9f6c1b273ca2f06)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:25.436532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:25.482602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:25.493381 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb8c6a2929d4f22a9f6c1b273ca2f06'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:25.502048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb8c6a2929d4f22a9f6c1b273ca2f06'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:25.509545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb8c6a2929d4f22a9f6c1b273ca2f06'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:25.510354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb8c6a2929d4f22a9f6c1b273ca2f06'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:25.523375 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb8c6a2929d4f22a9f6c1b273ca2f06'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:25.529912 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1371/2712] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:25 2022] DELETE /identity/v3/users/5bb8c6a2929d4f22a9f6c1b273ca2f06 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:25.534605 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:25.535090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:25.535090 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:25.555341 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:25.556524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:25.627000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1342/2713] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:25.636820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:25.638205 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:25.695453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7ff87-ec36-4bd1-8dbe-5f9a1c926ad4 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:25.699281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:25.699925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:25.700199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:25.700462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:25.711395 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:25.713048 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:25.723485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1372/2714] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:25.997672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:25.999482 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:26.017340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a7615-4081-4fb8-a8d5-9ce329372baf None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:26.023583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:26.024245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:26.024523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:26.024789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] PATH_INFO: `/v3/projects/881ac36000da4594a53e574ede049d69` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:26.026032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=881ac36000da4594a53e574ede049d69)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:26.028009 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:26.055104 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:26.088130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881ac36000da4594a53e574ede049d69', 'request_id': 'req-185dddd5-d445-4063-8101-5a81730c9a1f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.097931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881ac36000da4594a53e574ede049d69', 'request_id': 'req-185dddd5-d445-4063-8101-5a81730c9a1f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.104802 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881ac36000da4594a53e574ede049d69', 'request_id': 'req-185dddd5-d445-4063-8101-5a81730c9a1f'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.116485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] The token cache is being invalidate because project 881ac36000da4594a53e574ede049d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:26.116773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.117413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.118911 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1343/2715] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:25 2022] DELETE /identity/v3/projects/881ac36000da4594a53e574ede049d69 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:26.123099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:26.133540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88217616-3061-4f56-baf1-ca9be954b348 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:26.190498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:26.191132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:26.191408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:26.191671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] PATH_INFO: `/v3/users/2743d08557ad412794e3b4657bec1f0b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:26.192842 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2743d08557ad412794e3b4657bec1f0b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:26.195646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:26.253913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2743d08557ad412794e3b4657bec1f0b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.263140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2743d08557ad412794e3b4657bec1f0b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.265273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:26.273201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2743d08557ad412794e3b4657bec1f0b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.274116 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2743d08557ad412794e3b4657bec1f0b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.291243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b57410af-74e4-4f3b-91e5-1d969620966c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2743d08557ad412794e3b4657bec1f0b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.297664 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1373/2716] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:26 2022] DELETE /identity/v3/users/2743d08557ad412794e3b4657bec1f0b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:26.605335 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:26.606969 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:26.634135 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dddd5-d445-4063-8101-5a81730c9a1f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:26.745044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:26.745703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:26.745976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:26.746235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] PATH_INFO: `/v3/projects/924ae97b588a4712b1fd9048250453f9` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:26.747891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924ae97b588a4712b1fd9048250453f9)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:26.749834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:26.822194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924ae97b588a4712b1fd9048250453f9', 'request_id': 'req-71aa169a-208b-44ad-99c9-08fd8f08e482'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.832973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924ae97b588a4712b1fd9048250453f9', 'request_id': 'req-71aa169a-208b-44ad-99c9-08fd8f08e482'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.841213 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924ae97b588a4712b1fd9048250453f9', 'request_id': 'req-71aa169a-208b-44ad-99c9-08fd8f08e482'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.853793 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] The token cache is being invalidate because project 924ae97b588a4712b1fd9048250453f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:26.854086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.854742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-71aa169a-208b-44ad-99c9-08fd8f08e482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:26.856530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1344/2717] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:26 2022] DELETE /identity/v3/projects/924ae97b588a4712b1fd9048250453f9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:26.861440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971d67-5205-455a-8869-4b313c76e81b None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:26.861927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971d67-5205-455a-8869-4b313c76e81b None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:26.862123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971d67-5205-455a-8869-4b313c76e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:26.882059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-11971d67-5205-455a-8869-4b313c76e81b None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:26.883287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-11971d67-5205-455a-8869-4b313c76e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:26.943144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1374/2718] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:05:26.953109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b67dd-56c1-472a-afa8-aa3651b9a76a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:26.953380 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b67dd-56c1-472a-afa8-aa3651b9a76a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:26.953643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b67dd-56c1-472a-afa8-aa3651b9a76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:26.974348 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-251b67dd-56c1-472a-afa8-aa3651b9a76a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:26.976257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-251b67dd-56c1-472a-afa8-aa3651b9a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:26.985032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1345/2719] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:05:26.989329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971d67-5205-455a-8869-4b313c76e81b None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.000485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971d67-5205-455a-8869-4b313c76e81b None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.006489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.007140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.007385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.008663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.009396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:05:27.009683 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.011750 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.024796 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1375/2720] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:05:27.029445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b67dd-56c1-472a-afa8-aa3651b9a76a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.041106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b67dd-56c1-472a-afa8-aa3651b9a76a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.045912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.046530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.046886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.047089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.047706 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.049707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.083738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1346/2721] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:27 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:27.086237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.101089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99946459-43c0-48e2-b102-ee5f97f5e52c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.168582 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.169417 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.169535 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.169725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.170440 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.172305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.195303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1376/2722] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:27 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:27.199357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.216703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33a551-53c7-41cd-b070-d7c002e0623c admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.222224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.222924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.223275 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.223471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.224139 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.226422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.236857 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1347/2723] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:27.241210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.251037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05842ce-1ea3-4fc6-8a0c-6c626c0f4d30 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.255518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba811-f632-4fee-9c20-57a5c75bb466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.256214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba811-f632-4fee-9c20-57a5c75bb466 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.256682 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba811-f632-4fee-9c20-57a5c75bb466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.257141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba811-f632-4fee-9c20-57a5c75bb466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.257359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ba811-f632-4fee-9c20-57a5c75bb466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.258981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ba811-f632-4fee-9c20-57a5c75bb466 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.270302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1377/2724] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:27.274272 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.279440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:27.284997 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41aad8-15b2-4e26-9796-7f544e2faca6 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.290563 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.291309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.291678 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.292039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] PATH_INFO: `/v3/projects/40d4359661e042a3be2c7e8da4d27cff/users/380a8cd8bb254265a6111c32aa3bc8d4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.312462 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d4359661e042a3be2c7e8da4d27cff, user_id=380a8cd8bb254265a6111c32aa3bc8d4, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.315108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.330904 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1348/2725] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:27 2022] PUT /identity/v3/projects/40d4359661e042a3be2c7e8da4d27cff/users/380a8cd8bb254265a6111c32aa3bc8d4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:27.341955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91419017-8934-42ee-ab31-c789391cdd83 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.342234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91419017-8934-42ee-ab31-c789391cdd83 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.342495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91419017-8934-42ee-ab31-c789391cdd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.379329 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-91419017-8934-42ee-ab31-c789391cdd83 None None] MFA Rules not processed for user `380a8cd8bb254265a6111c32aa3bc8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:27.380624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-91419017-8934-42ee-ab31-c789391cdd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:27.411768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:27.454862 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1378/2726] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:27.459893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.524054 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4a0aa-ac6c-424d-bbd6-0e0b68362109 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.528600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c60d-6125-4639-977a-718819109670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.529212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c60d-6125-4639-977a-718819109670 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.529545 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c60d-6125-4639-977a-718819109670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.529767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c60d-6125-4639-977a-718819109670 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.530386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c60d-6125-4639-977a-718819109670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.532315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c60d-6125-4639-977a-718819109670 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.561211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1349/2727] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:27 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:27.565572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91419017-8934-42ee-ab31-c789391cdd83 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.576451 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91419017-8934-42ee-ab31-c789391cdd83 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.635455 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.636136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.636404 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.636661 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.637302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.639258 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.663419 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1379/2728] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:27 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:05:27.667480 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c60d-6125-4639-977a-718819109670 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.677737 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c60d-6125-4639-977a-718819109670 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.682923 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.683544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.683854 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.684118 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.684709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.686328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.697370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1350/2729] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:27.701210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.711468 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e68be-465f-49bc-b154-78e7b984a40d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.716305 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effefcf1-1368-482e-a2c2-2314e38ab595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.716901 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effefcf1-1368-482e-a2c2-2314e38ab595 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.717172 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effefcf1-1368-482e-a2c2-2314e38ab595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.717439 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effefcf1-1368-482e-a2c2-2314e38ab595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.718067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effefcf1-1368-482e-a2c2-2314e38ab595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.719640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effefcf1-1368-482e-a2c2-2314e38ab595 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.730211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1380/2730] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:05:27.737379 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.748481 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef831a-8361-48a5-8292-3c3fc79da22a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.753246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.753905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.754182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.754447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] PATH_INFO: `/v3/projects/55bca121047b45bea19cdaff5dc65833/users/8f12defa536d49f289a946e3d5d37648/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.770202 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bca121047b45bea19cdaff5dc65833, user_id=8f12defa536d49f289a946e3d5d37648, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.772922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:27.788497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1351/2731] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:27 2022] PUT /identity/v3/projects/55bca121047b45bea19cdaff5dc65833/users/8f12defa536d49f289a946e3d5d37648/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:27.800336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165939-0154-4176-bf44-e395df24904a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.800617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165939-0154-4176-bf44-e395df24904a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.800908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165939-0154-4176-bf44-e395df24904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.829045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-89165939-0154-4176-bf44-e395df24904a None None] MFA Rules not processed for user `8f12defa536d49f289a946e3d5d37648`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:27.830256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-89165939-0154-4176-bf44-e395df24904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:27.899526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1381/2732] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:27.904321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:27.970417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc28de4-458d-47b3-985a-c13660bc4dd9 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:27.975149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:27.975858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:27.976207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:27.976483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:27.977126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:27.979073 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:28.011201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1352/2733] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:27 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:28.012406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89165939-0154-4176-bf44-e395df24904a None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:28.024484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89165939-0154-4176-bf44-e395df24904a None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:28.059053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:28.085134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:28.085516 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:28.085790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:28.086054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:28.086747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:28.088697 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:28.112913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1382/2734] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:28 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:05:28.117103 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:28.127515 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730aecb-f8af-4dde-952d-3a1fc0008458 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:28.132782 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:28.133396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:28.133670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:28.133936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:28.134616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:28.136247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:28.150884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1353/2735] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:28.152070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:28.162054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e4075-9246-46b3-8978-1a9f0bf9e378 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:28.167060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:28.167722 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:28.168018 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:28.168289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] PATH_INFO: `/v3/projects/32d608b1790c4f9d926472072b3a2eb9/users/311046c1b801480b8e005bac990e485b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:28.183895 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d608b1790c4f9d926472072b3a2eb9, user_id=311046c1b801480b8e005bac990e485b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:28.186556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:28.201476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1383/2736] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:28 2022] PUT /identity/v3/projects/32d608b1790c4f9d926472072b3a2eb9/users/311046c1b801480b8e005bac990e485b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:28.205434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:28.210952 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:28.217257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b96d7-f6f7-4ed0-a684-d17920413a33 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:28.276363 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42955b-1875-4b79-a7ff-c54b34bb7e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:28.277060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42955b-1875-4b79-a7ff-c54b34bb7e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:28.277375 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42955b-1875-4b79-a7ff-c54b34bb7e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:28.277688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42955b-1875-4b79-a7ff-c54b34bb7e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:28.278474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42955b-1875-4b79-a7ff-c54b34bb7e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:28.280269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42955b-1875-4b79-a7ff-c54b34bb7e34 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:28.291201 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1354/2737] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:05:28.295336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:28.305982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd32e-270f-4650-aa65-b536584ffcb6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:28.311220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:28.311927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:28.312191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:28.312588 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] PATH_INFO: `/v3/projects/32d608b1790c4f9d926472072b3a2eb9/users/311046c1b801480b8e005bac990e485b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:28.314785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d608b1790c4f9d926472072b3a2eb9, user_id=311046c1b801480b8e005bac990e485b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:28.317480 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:28.329286 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1384/2738] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:28 2022] PUT /identity/v3/projects/32d608b1790c4f9d926472072b3a2eb9/users/311046c1b801480b8e005bac990e485b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:28.341121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58774-d314-47d5-916e-2ec704e66433 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:28.341405 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58774-d314-47d5-916e-2ec704e66433 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:28.341676 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58774-d314-47d5-916e-2ec704e66433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:28.371855 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-aeb58774-d314-47d5-916e-2ec704e66433 None None] MFA Rules not processed for user `311046c1b801480b8e005bac990e485b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:28.373165 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-aeb58774-d314-47d5-916e-2ec704e66433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:28.453536 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1355/2739] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:28.465532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:28.467279 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:28.530513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493ad0f-a498-4bea-9304-da047d569fa9 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:28.536248 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:28.536847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:28.537130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:28.537487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:28.596597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:28.598028 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:28.612679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1385/2740] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:29.645417 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878eba8-a563-45da-be9c-148f620c229c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:29.645981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878eba8-a563-45da-be9c-148f620c229c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:29.646329 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878eba8-a563-45da-be9c-148f620c229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:29.666357 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-0878eba8-a563-45da-be9c-148f620c229c None None] MFA Rules not processed for user `1aff5c3ba252435fb64568ee34d2d986`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:29.667606 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0878eba8-a563-45da-be9c-148f620c229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:29.727979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1356/2741] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:30.066941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:30.068585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:30.126017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:30.143868 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee852-582d-411e-911e-42fbca349a9e service cinder] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:30.147640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:30.148769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878eba8-a563-45da-be9c-148f620c229c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:30.148975 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:30.149265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:30.149514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:30.150168 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-0878eba8-a563-45da-be9c-148f620c229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:30.151220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:30.161245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:30.162696 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:30.162973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878eba8-a563-45da-be9c-148f620c229c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:30.166517 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:30.167124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:30.167399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:30.167661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:30.171685 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1386/2742] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:30.194671 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=100 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:30.232355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:30.233878 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:30.245245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1357/2743] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:30.831827 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:30.842085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb5f72-c16c-4286-b4e0-e790d8a1d878 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:30.845951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0067af7-e2cb-4a16-8bfa-2a0ddfb50c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:30.846652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067af7-e2cb-4a16-8bfa-2a0ddfb50c34 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:30.846925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067af7-e2cb-4a16-8bfa-2a0ddfb50c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:30.847155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0067af7-e2cb-4a16-8bfa-2a0ddfb50c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:30.856877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0067af7-e2cb-4a16-8bfa-2a0ddfb50c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:30.858310 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0067af7-e2cb-4a16-8bfa-2a0ddfb50c34 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:30.868487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1387/2744] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:34.817020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:34.884844 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f4a26-b50c-42b2-9708-f55ab763f47c service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:34.889624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:34.890269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:34.890543 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:34.890810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] PATH_INFO: `/v3/users/380a8cd8bb254265a6111c32aa3bc8d4` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:34.891975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380a8cd8bb254265a6111c32aa3bc8d4)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:34.893922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:34.945385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380a8cd8bb254265a6111c32aa3bc8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:34.953970 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380a8cd8bb254265a6111c32aa3bc8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:34.954738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380a8cd8bb254265a6111c32aa3bc8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:34.955407 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380a8cd8bb254265a6111c32aa3bc8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:34.963229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380a8cd8bb254265a6111c32aa3bc8d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:34.981143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1358/2745] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:34 2022] DELETE /identity/v3/users/380a8cd8bb254265a6111c32aa3bc8d4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:34.985733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:34.986244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:34.986244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:35.005016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:35.006192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:35.067145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1388/2746] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:35.077396 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:35.079225 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:35.134825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:35.142540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e8722-f168-40d7-9e7b-b03e69a04138 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:35.147578 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:35.148719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:35.149399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:35.149790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:35.163470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:35.165220 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:35.184409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1359/2747] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:35.550098 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:35.551636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:35.565617 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc920-e0ba-4691-a514-2403e1933937 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:35.570454 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:35.571112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:35.571371 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:35.571636 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] PATH_INFO: `/v3/projects/40d4359661e042a3be2c7e8da4d27cff` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:35.572822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d4359661e042a3be2c7e8da4d27cff)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:35.574735 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:35.636281 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d4359661e042a3be2c7e8da4d27cff', 'request_id': 'req-5dee1e19-80b3-4519-81a9-7458ac647d93'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.645278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d4359661e042a3be2c7e8da4d27cff', 'request_id': 'req-5dee1e19-80b3-4519-81a9-7458ac647d93'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.650936 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d4359661e042a3be2c7e8da4d27cff', 'request_id': 'req-5dee1e19-80b3-4519-81a9-7458ac647d93'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.661893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] The token cache is being invalidate because project 40d4359661e042a3be2c7e8da4d27cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:35.662177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.662806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.664342 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1389/2748] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:35 2022] DELETE /identity/v3/projects/40d4359661e042a3be2c7e8da4d27cff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:35.668724 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:35.678253 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8785-c111-4fbc-ae8c-eca53f384b49 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:35.734060 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:35.734719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:35.735010 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:35.735262 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] PATH_INFO: `/v3/users/8f12defa536d49f289a946e3d5d37648` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:35.736394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f12defa536d49f289a946e3d5d37648)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:35.738314 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:35.792136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f12defa536d49f289a946e3d5d37648'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.804941 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f12defa536d49f289a946e3d5d37648'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.805604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f12defa536d49f289a946e3d5d37648'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.806234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f12defa536d49f289a946e3d5d37648'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.814803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f12defa536d49f289a946e3d5d37648'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:35.833666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1360/2749] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:35 2022] DELETE /identity/v3/users/8f12defa536d49f289a946e3d5d37648 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:36.126933 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:36.128520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:36.142171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee1e19-80b3-4519-81a9-7458ac647d93 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:36.204084 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:36.211747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:36.212497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:36.212816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:36.213123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] PATH_INFO: `/v3/projects/55bca121047b45bea19cdaff5dc65833` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:36.214860 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bca121047b45bea19cdaff5dc65833)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:36.217924 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:36.273597 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bca121047b45bea19cdaff5dc65833', 'request_id': 'req-0a3cc850-d791-4915-ade3-a4ceb490a80f'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.284273 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bca121047b45bea19cdaff5dc65833', 'request_id': 'req-0a3cc850-d791-4915-ade3-a4ceb490a80f'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.290502 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bca121047b45bea19cdaff5dc65833', 'request_id': 'req-0a3cc850-d791-4915-ade3-a4ceb490a80f'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.301846 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] The token cache is being invalidate because project 55bca121047b45bea19cdaff5dc65833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:36.302095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.302831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.304496 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1390/2750] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:36 2022] DELETE /identity/v3/projects/55bca121047b45bea19cdaff5dc65833 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:36.309126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:36.310588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:36.323810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15c5d7-da21-4f8e-9d09-05df7a0e037b admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:36.388832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:36.389470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:36.389748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:36.390013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] PATH_INFO: `/v3/users/311046c1b801480b8e005bac990e485b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:36.391163 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=311046c1b801480b8e005bac990e485b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:36.393102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:36.404311 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:36.452529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311046c1b801480b8e005bac990e485b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.462741 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311046c1b801480b8e005bac990e485b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.463931 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311046c1b801480b8e005bac990e485b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.464635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311046c1b801480b8e005bac990e485b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.472784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-eefe28e9-aacf-400c-85c6-b3a80dc439cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311046c1b801480b8e005bac990e485b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.492758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1361/2751] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:36 2022] DELETE /identity/v3/users/311046c1b801480b8e005bac990e485b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:05:36.785338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:36.786928 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:36.805902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cc850-d791-4915-ade3-a4ceb490a80f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:36.868209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:36.868778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:36.869050 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:36.869304 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] PATH_INFO: `/v3/projects/32d608b1790c4f9d926472072b3a2eb9` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:36.870713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d608b1790c4f9d926472072b3a2eb9)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:36.872681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:36.921296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d608b1790c4f9d926472072b3a2eb9', 'request_id': 'req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.931064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d608b1790c4f9d926472072b3a2eb9', 'request_id': 'req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.937210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d608b1790c4f9d926472072b3a2eb9', 'request_id': 'req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.948823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] The token cache is being invalidate because project 32d608b1790c4f9d926472072b3a2eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:05:36.949101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.949731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d9d259ad-8eac-4e7a-9da0-a83ef7e30b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:36.951194 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1391/2752] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:05:36 2022] DELETE /identity/v3/projects/32d608b1790c4f9d926472072b3a2eb9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:36.957082 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943001-8a06-4503-89d5-cf83b17751e5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:36.957581 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943001-8a06-4503-89d5-cf83b17751e5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:36.957874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943001-8a06-4503-89d5-cf83b17751e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:36.980125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-2f943001-8a06-4503-89d5-cf83b17751e5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:36.981421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-2f943001-8a06-4503-89d5-cf83b17751e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:37.051748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1362/2753] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:05:37.054029 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a933a-0fa6-40e2-8e09-8297bcc93595 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.054416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a933a-0fa6-40e2-8e09-8297bcc93595 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.054943 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a933a-0fa6-40e2-8e09-8297bcc93595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.076298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-676a933a-0fa6-40e2-8e09-8297bcc93595 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:37.077641 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-676a933a-0fa6-40e2-8e09-8297bcc93595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:37.086054 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1392/2754] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:05:37.090790 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f943001-8a06-4503-89d5-cf83b17751e5 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:37.100955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f943001-8a06-4503-89d5-cf83b17751e5 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:37.106198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:37.106834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.107109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.107370 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.108044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:05:37.108340 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:37.109936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:37.122520 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1363/2755] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:05:37.126837 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a933a-0fa6-40e2-8e09-8297bcc93595 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:37.136309 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a933a-0fa6-40e2-8e09-8297bcc93595 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:37.141980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:37.142781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.143064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.143330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.144181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:37.146145 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:37.157761 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:37.178489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1393/2756] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:05:37 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:37.182920 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:37.193562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ef18d-617c-41d1-8bf5-150330c41191 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:37.254954 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:37.255564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.255867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.256133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.256757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:37.258692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:37.280852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1364/2757] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:05:37 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:05:37.285007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:37.298167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba4e2-bf44-4a11-b9f1-746f4d8b7b0d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:37.304292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:37.304939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.305208 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.305583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.306268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:37.307960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:37.318539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1394/2758] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:37.323088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:37.329870 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:37.334540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4551d-32f9-4d58-9e1a-83d2f3d5ca3a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:37.340965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d898-54c6-4547-8314-e9dc680340ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:37.341559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d898-54c6-4547-8314-e9dc680340ef admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.341989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d898-54c6-4547-8314-e9dc680340ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.342279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d898-54c6-4547-8314-e9dc680340ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.342961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d898-54c6-4547-8314-e9dc680340ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:37.345043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d898-54c6-4547-8314-e9dc680340ef admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:37.356190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1365/2759] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:05:37.360536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:37.370859 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429b12-3d84-41dc-8591-5b4e40660605 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:37.376789 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:37.377390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.377670 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.377941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] PATH_INFO: `/v3/projects/8b839e1ae1b245dc90b15bd1d9f516ba/users/fb171defea7c4f89be868d56c8873e92/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.394025 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b839e1ae1b245dc90b15bd1d9f516ba, user_id=fb171defea7c4f89be868d56c8873e92, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:37.396720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:37.415131 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1395/2760] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:05:37 2022] PUT /identity/v3/projects/8b839e1ae1b245dc90b15bd1d9f516ba/users/fb171defea7c4f89be868d56c8873e92/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:37.486315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4592-fb3c-445c-8286-ff96f92f0a94 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.486652 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4592-fb3c-445c-8286-ff96f92f0a94 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.487053 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d4592-fb3c-445c-8286-ff96f92f0a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.522003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-162d4592-fb3c-445c-8286-ff96f92f0a94 None None] MFA Rules not processed for user `fb171defea7c4f89be868d56c8873e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:37.523230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-162d4592-fb3c-445c-8286-ff96f92f0a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:37.593308 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1366/2761] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:37.605766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:37.607815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:37.670601 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954c14-9c2d-40d4-9f54-04b981ce7a3d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:37.674487 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f718e-9b2b-46aa-aafc-367ebb59483b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:37.675107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f718e-9b2b-46aa-aafc-367ebb59483b service glance] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:37.675462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f718e-9b2b-46aa-aafc-367ebb59483b service glance] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:37.675870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f718e-9b2b-46aa-aafc-367ebb59483b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:37.686514 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f718e-9b2b-46aa-aafc-367ebb59483b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:37.687991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f718e-9b2b-46aa-aafc-367ebb59483b service glance] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:37.697153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1396/2762] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:05:47.589936 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=35 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:47.693445 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:05:59.480292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4592-fb3c-445c-8286-ff96f92f0a94 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:59.548984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d4592-fb3c-445c-8286-ff96f92f0a94 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:59.554293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:59.554919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:59.555198 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:59.555459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] PATH_INFO: `/v3/users/fb171defea7c4f89be868d56c8873e92` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:59.556719 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb171defea7c4f89be868d56c8873e92)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:59.558684 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:59.612414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb171defea7c4f89be868d56c8873e92'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:59.622538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb171defea7c4f89be868d56c8873e92'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:59.623086 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb171defea7c4f89be868d56c8873e92'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:59.623801 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb171defea7c4f89be868d56c8873e92'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:59.630945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb171defea7c4f89be868d56c8873e92'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:05:59.649221 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1367/2763] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:05:59 2022] DELETE /identity/v3/users/fb171defea7c4f89be868d56c8873e92 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:05:59.653718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:59.654174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:59.654272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:59.674821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:05:59.676109 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:59.743710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1397/2764] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:05:59.753615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:05:59.755178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:05:59.816832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1670b-335e-4910-970a-795c8f155d97 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:05:59.820884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81e97f-3f40-49d5-8460-5efb49c17eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:05:59.821486 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e97f-3f40-49d5-8460-5efb49c17eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:05:59.821758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e97f-3f40-49d5-8460-5efb49c17eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:05:59.822019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e97f-3f40-49d5-8460-5efb49c17eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:05:59.833126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81e97f-3f40-49d5-8460-5efb49c17eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:05:59.834577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81e97f-3f40-49d5-8460-5efb49c17eb8 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:05:59.844973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1368/2765] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:06:00.115684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.117768 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:00.130408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9f729-0c79-461b-a6c0-ae7af985b79a None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.141624 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.142357 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.142640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.142908 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] PATH_INFO: `/v3/projects/8b839e1ae1b245dc90b15bd1d9f516ba` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.144195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b839e1ae1b245dc90b15bd1d9f516ba)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.146091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.198497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b839e1ae1b245dc90b15bd1d9f516ba', 'request_id': 'req-0bc9275c-6278-4329-a3ec-765d4ffc121a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:06:00.208497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b839e1ae1b245dc90b15bd1d9f516ba', 'request_id': 'req-0bc9275c-6278-4329-a3ec-765d4ffc121a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:06:00.214365 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b839e1ae1b245dc90b15bd1d9f516ba', 'request_id': 'req-0bc9275c-6278-4329-a3ec-765d4ffc121a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:06:00.225431 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] The token cache is being invalidate because project 8b839e1ae1b245dc90b15bd1d9f516ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:06:00.225738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:06:00.226401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-0bc9275c-6278-4329-a3ec-765d4ffc121a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:06:00.227894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1398/2766] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:06:00 2022] DELETE /identity/v3/projects/8b839e1ae1b245dc90b15bd1d9f516ba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:06:00.233512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65286ed8-3c7a-4b1f-ba73-208ce442575f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.233794 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65286ed8-3c7a-4b1f-ba73-208ce442575f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.234056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65286ed8-3c7a-4b1f-ba73-208ce442575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.254479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-65286ed8-3c7a-4b1f-ba73-208ce442575f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:06:00.255664 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-65286ed8-3c7a-4b1f-ba73-208ce442575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:00.278770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:00.321973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1369/2767] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:06:00.330196 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145520e-dc3e-4bc6-9bc6-7d775e6db653 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.330474 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145520e-dc3e-4bc6-9bc6-7d775e6db653 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.330738 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145520e-dc3e-4bc6-9bc6-7d775e6db653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.352008 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e145520e-dc3e-4bc6-9bc6-7d775e6db653 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:06:00.353214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e145520e-dc3e-4bc6-9bc6-7d775e6db653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:00.361266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1399/2768] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:06:00.365566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65286ed8-3c7a-4b1f-ba73-208ce442575f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.376101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65286ed8-3c7a-4b1f-ba73-208ce442575f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.381440 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.382044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.382320 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.382587 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.383227 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:06:00.383528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.385349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.397989 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1370/2769] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:06:00.402412 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145520e-dc3e-4bc6-9bc6-7d775e6db653 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.412017 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145520e-dc3e-4bc6-9bc6-7d775e6db653 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.418064 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.418659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.418925 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.419185 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.419856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.421739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.453615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1400/2770] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:06:00 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:06:00.458218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.468474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850399c-6608-4c4d-9310-59f1fbac97db admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.534130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.535122 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.535230 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.535544 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.536502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.539133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.565928 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1371/2771] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:06:00 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:06:00.570330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.581265 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f27bf-c4ef-466f-ab54-55e2f6098e3f admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.586838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.587452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.587720 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.587999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.588934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.590556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.601019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1401/2772] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:06:00.605703 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.621074 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b82964-866d-4fa1-81cd-189deddc6f31 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.626376 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab948db2-0fba-46fd-be1b-cefc32810643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.626991 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab948db2-0fba-46fd-be1b-cefc32810643 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.627271 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab948db2-0fba-46fd-be1b-cefc32810643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.627540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab948db2-0fba-46fd-be1b-cefc32810643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.628218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab948db2-0fba-46fd-be1b-cefc32810643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.629823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab948db2-0fba-46fd-be1b-cefc32810643 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.640733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1372/2773] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:06:00.645086 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.656063 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f114e6-c54d-4afa-84d8-f8556f1b17d6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.661666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.662313 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.662594 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.662856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] PATH_INFO: `/v3/projects/13edf09dc2b249958b4020dcc7e94291/users/b02063ce6d3d45d6895d1e2a782efe3b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.677999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13edf09dc2b249958b4020dcc7e94291, user_id=b02063ce6d3d45d6895d1e2a782efe3b, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.680731 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.700484 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1402/2774] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:06:00 2022] PUT /identity/v3/projects/13edf09dc2b249958b4020dcc7e94291/users/b02063ce6d3d45d6895d1e2a782efe3b/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:06:00.706020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b4ce3-a194-469e-8eaf-d480046caa4f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.706187 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b4ce3-a194-469e-8eaf-d480046caa4f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.706513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b4ce3-a194-469e-8eaf-d480046caa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.736241 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-1d4b4ce3-a194-469e-8eaf-d480046caa4f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:06:00.737447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1d4b4ce3-a194-469e-8eaf-d480046caa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:00.808753 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1373/2775] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:06:00.818707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:00.820452 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:00.842710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:00.879221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f451a2b-b24a-4024-9851-9fe4cd83a57d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:00.883513 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:00.884211 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:00.884521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:00.884821 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:00.894047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:00.895469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:00.905093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1403/2776] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:06:04.865843 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3c781-789f-4b35-8a83-d1861fa29a4d None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:04.866410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3c781-789f-4b35-8a83-d1861fa29a4d None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:04.866410 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3c781-789f-4b35-8a83-d1861fa29a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:04.901824 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-9ca3c781-789f-4b35-8a83-d1861fa29a4d None None] MFA Rules not processed for user `b02063ce6d3d45d6895d1e2a782efe3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:06:04.903038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9ca3c781-789f-4b35-8a83-d1861fa29a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:04.920757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:04.970506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1374/2777] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:06:04.976769 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:04.987739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5730-159c-41cf-9719-d3e239ba8e84 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:04.992512 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:04.993121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:04.993413 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:04.993704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:04.994435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:04.996256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:05.041178 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1404/2778] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:06:04 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:06:05.047976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3c781-789f-4b35-8a83-d1861fa29a4d None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:05.069406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3c781-789f-4b35-8a83-d1861fa29a4d None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:05.130125 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:05.130778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:05.131013 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:05.131306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:05.131957 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:05.133861 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:05.161689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1375/2779] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:06:05 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:06:05.166530 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:05.177546 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee61b87-2ce0-4231-943b-188cc1bc2fb1 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:05.182725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:05.183986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:05.184269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:05.184567 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:05.185220 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:05.186840 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:05.198467 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1405/2780] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:06:05.202919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:05.213561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e615c-d708-46da-83c8-b4b5af66b1fd admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:05.218524 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:05.219347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:05.219635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:05.219942 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] PATH_INFO: `/v3/projects/2961ed1182f149ad83f76e97eb323411/users/b05aabb1f0fc4c88a8a8bb09eab46b3d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:05.236955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2961ed1182f149ad83f76e97eb323411, user_id=b05aabb1f0fc4c88a8a8bb09eab46b3d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:05.239776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:05.254774 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1376/2781] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:06:05 2022] PUT /identity/v3/projects/2961ed1182f149ad83f76e97eb323411/users/b05aabb1f0fc4c88a8a8bb09eab46b3d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:06:05.258865 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:05.269515 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d1a6-ab39-43b6-8939-e1b111047547 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:05.329091 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398b73f-b1fc-4f36-a89a-2920611a089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:05.330060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b73f-b1fc-4f36-a89a-2920611a089e admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:05.330330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b73f-b1fc-4f36-a89a-2920611a089e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:05.330589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b73f-b1fc-4f36-a89a-2920611a089e admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:05.331222 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b73f-b1fc-4f36-a89a-2920611a089e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:05.332847 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b73f-b1fc-4f36-a89a-2920611a089e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:05.344553 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1406/2782] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:06:05.348443 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:05.360108 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56642ea2-e3c0-4176-8fdf-4b5c2d05e108 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:05.365670 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:05.366660 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:05.366951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:05.367254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] PATH_INFO: `/v3/projects/2961ed1182f149ad83f76e97eb323411/users/b05aabb1f0fc4c88a8a8bb09eab46b3d/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:05.369471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2961ed1182f149ad83f76e97eb323411, user_id=b05aabb1f0fc4c88a8a8bb09eab46b3d, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:05.372433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:05.386474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1377/2783] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:06:05 2022] PUT /identity/v3/projects/2961ed1182f149ad83f76e97eb323411/users/b05aabb1f0fc4c88a8a8bb09eab46b3d/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:06:09.628637 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2992-5338-4d03-ac83-bab198b16476 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:09.629137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2992-5338-4d03-ac83-bab198b16476 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:09.629236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2992-5338-4d03-ac83-bab198b16476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:09.668414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-122b2992-5338-4d03-ac83-bab198b16476 None None] MFA Rules not processed for user `b05aabb1f0fc4c88a8a8bb09eab46b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:06:09.669739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-122b2992-5338-4d03-ac83-bab198b16476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:09.740710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1407/2784] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:06:09.759475 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:09.762681 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:09.839332 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a97633-3eac-4f35-be05-314f2776f4a1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:09.845212 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd0680-cafc-490e-8290-ce27cffb34f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:09.845906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0680-cafc-490e-8290-ce27cffb34f3 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:09.846188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0680-cafc-490e-8290-ce27cffb34f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:09.846456 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd0680-cafc-490e-8290-ce27cffb34f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:09.852762 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:09.910130 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0680-cafc-490e-8290-ce27cffb34f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:09.911738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd0680-cafc-490e-8290-ce27cffb34f3 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:09.922124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1378/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:06:11.060191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9e91-6adb-4fe9-96f8-1f487a661ea6 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:11.060866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9e91-6adb-4fe9-96f8-1f487a661ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:11.060866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9e91-6adb-4fe9-96f8-1f487a661ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:11.081556 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-59ed9e91-6adb-4fe9-96f8-1f487a661ea6 None None] MFA Rules not processed for user `b02063ce6d3d45d6895d1e2a782efe3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:06:11.083046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-59ed9e91-6adb-4fe9-96f8-1f487a661ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:11.090681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1408/2786] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:06:19.916939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=24 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:21.074854 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:26.680145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed0174-448b-4487-be0e-fb7cde2e4d3c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:26.680763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed0174-448b-4487-be0e-fb7cde2e4d3c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:26.680763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed0174-448b-4487-be0e-fb7cde2e4d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:26.700572 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-90ed0174-448b-4487-be0e-fb7cde2e4d3c None None] MFA Rules not processed for user `1aff5c3ba252435fb64568ee34d2d986`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:06:26.701712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-90ed0174-448b-4487-be0e-fb7cde2e4d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:26.760573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1379/2787] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:06:35.303724 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9e91-6adb-4fe9-96f8-1f487a661ea6 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:35.360849 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9e91-6adb-4fe9-96f8-1f487a661ea6 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:35.364383 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:35.364988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:35.365266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:35.365528 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:35.379060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:35.380932 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:35.391498 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1409/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:06:36.753538 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=25 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:37.297078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed0174-448b-4487-be0e-fb7cde2e4d3c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:37.312955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed0174-448b-4487-be0e-fb7cde2e4d3c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:37.319301 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:37.319956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:37.320387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:37.320672 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:37.322588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:37.337476 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:37.339738 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:37.351592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1380/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:06:45.386608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=26 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:47.346088 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=6 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:06:48.830166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:06:48.831863 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:48.979834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f6197-3c79-4849-958d-b4b89425ecdb service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:06:48.986331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:06:48.986939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:06:48.987216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:06:48.987486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:06:48.989359 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:06:49.001870 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:06:49.003447 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:06:49.014005 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1410/2790] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:06:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:06:59.009290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=63 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:30.376309 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:30.377925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:30.522832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f394d9-81eb-457d-8155-9b950188d610 service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:30.528150 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:30.528776 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:30.529047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:30.529310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] PATH_INFO: `/v3/users/1aff5c3ba252435fb64568ee34d2d986` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:30.530464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aff5c3ba252435fb64568ee34d2d986)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:30.532399 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:30.582838 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aff5c3ba252435fb64568ee34d2d986'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.592620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aff5c3ba252435fb64568ee34d2d986'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.593353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aff5c3ba252435fb64568ee34d2d986'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.594075 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aff5c3ba252435fb64568ee34d2d986'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.601059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-700517b2-1d9d-44b7-8148-cecfe251e960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aff5c3ba252435fb64568ee34d2d986'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.620322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1381/2791] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:30 2022] DELETE /identity/v3/users/1aff5c3ba252435fb64568ee34d2d986 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:30.797615 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:30.808681 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b5c69-3120-40bc-824e-f5bd2da5103c service placement] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:30.870347 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:30.870982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:30.871256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:30.871522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] PATH_INFO: `/v3/projects/6ac88fff43d24eb5b87c47bfcaa82442` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:30.872705 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac88fff43d24eb5b87c47bfcaa82442)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:30.874707 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:30.931256 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac88fff43d24eb5b87c47bfcaa82442', 'request_id': 'req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.940678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac88fff43d24eb5b87c47bfcaa82442', 'request_id': 'req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.946540 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac88fff43d24eb5b87c47bfcaa82442', 'request_id': 'req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.958055 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] The token cache is being invalidate because project 6ac88fff43d24eb5b87c47bfcaa82442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:30.958331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.958991 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-c855afa3-e7aa-4071-bc4a-78e69b3b8ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:30.960533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1411/2792] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:30 2022] DELETE /identity/v3/projects/6ac88fff43d24eb5b87c47bfcaa82442 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:30.966224 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ef04e-4e76-4f6e-b7db-035dc053648f None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:30.966745 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ef04e-4e76-4f6e-b7db-035dc053648f None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:30.967254 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ef04e-4e76-4f6e-b7db-035dc053648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:30.992038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:31.029953 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-020ef04e-4e76-4f6e-b7db-035dc053648f None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:31.031205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-020ef04e-4e76-4f6e-b7db-035dc053648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:31.094100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1382/2793] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:31.105595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea9355-0cb7-4eca-8c13-c041230e6247 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.105872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea9355-0cb7-4eca-8c13-c041230e6247 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.106139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea9355-0cb7-4eca-8c13-c041230e6247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.128177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-dcea9355-0cb7-4eca-8c13-c041230e6247 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:31.129397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-dcea9355-0cb7-4eca-8c13-c041230e6247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:31.138181 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1412/2794] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:31.142795 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ef04e-4e76-4f6e-b7db-035dc053648f None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.152869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ef04e-4e76-4f6e-b7db-035dc053648f None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.158808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.159406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.159679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.159979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.160615 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:07:31.160909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.162502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.174756 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1383/2795] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:07:31.179134 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea9355-0cb7-4eca-8c13-c041230e6247 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.188798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea9355-0cb7-4eca-8c13-c041230e6247 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.194462 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.195053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.195323 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.195581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.196228 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.198135 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.232909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1413/2796] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:31 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:31.237712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.247981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d807a-47e6-4b07-ad8c-e7fbdc854679 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.310106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.310707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.310981 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.311248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.311925 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.313885 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.338540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1384/2797] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:31 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:31.342800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.353923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b6426-9b01-435e-841a-c3f2c47f3fa2 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.359128 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.359803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.360066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.360336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.360969 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.362577 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.373442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1414/2798] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:31.378245 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.388325 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a7837-ae6d-46e4-86f8-a1597a8d4eff admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.393596 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1772cdb-acb9-4d60-b48d-164e05b3e9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.394193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772cdb-acb9-4d60-b48d-164e05b3e9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.394468 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772cdb-acb9-4d60-b48d-164e05b3e9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.394736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772cdb-acb9-4d60-b48d-164e05b3e9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.395367 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1772cdb-acb9-4d60-b48d-164e05b3e9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.397000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1772cdb-acb9-4d60-b48d-164e05b3e9cb admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.407839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1385/2799] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:31.412214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.424190 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a93be-d66d-4f9b-a218-d7d3a6722c6e admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.429043 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.429838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.430117 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.430382 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] PATH_INFO: `/v3/projects/ab104ec3627d4fd9ab9f2c89a6ae2e26/users/9d99f878ffbe49fcbc9190f2060c224e/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.446979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab104ec3627d4fd9ab9f2c89a6ae2e26, user_id=9d99f878ffbe49fcbc9190f2060c224e, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.450142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.468287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1415/2800] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:31 2022] PUT /identity/v3/projects/ab104ec3627d4fd9ab9f2c89a6ae2e26/users/9d99f878ffbe49fcbc9190f2060c224e/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:31.479031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb53e-80a1-44e0-9fec-83e03c8959e0 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.479338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb53e-80a1-44e0-9fec-83e03c8959e0 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.479607 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb53e-80a1-44e0-9fec-83e03c8959e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.508877 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-613cb53e-80a1-44e0-9fec-83e03c8959e0 None None] MFA Rules not processed for user `9d99f878ffbe49fcbc9190f2060c224e`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:31.510507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-613cb53e-80a1-44e0-9fec-83e03c8959e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:31.555455 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:31.580274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1386/2801] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:31.584915 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.614713 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:31.649717 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf179e-021d-46a2-8229-f7756a1648e8 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.654654 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.655263 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.655541 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.655838 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.656557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.658469 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.688882 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1416/2802] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:31 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:31.693052 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cb53e-80a1-44e0-9fec-83e03c8959e0 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.704621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cb53e-80a1-44e0-9fec-83e03c8959e0 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.766291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.766905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.767176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.767438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.768126 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.770038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.796234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1387/2803] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:31 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:31.800688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.811942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7d234-0e20-4af9-b5bd-c762af11cb4c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.816850 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.817453 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.817730 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.817996 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.818622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.820280 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.830662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1417/2804] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:31.835589 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.849042 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a892c-bf5f-4f41-b0a9-a652e7241276 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.854347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.855003 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.855281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.855547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] PATH_INFO: `/v3/projects/f3d7d58abdff4236907ce64d6e79d476/users/229d95b8c1e24373a2ea062cc6d4621b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.872575 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d7d58abdff4236907ce64d6e79d476, user_id=229d95b8c1e24373a2ea062cc6d4621b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.875799 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.896669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1388/2805] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:31 2022] PUT /identity/v3/projects/f3d7d58abdff4236907ce64d6e79d476/users/229d95b8c1e24373a2ea062cc6d4621b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:31.897257 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.906977 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6a78-1335-4410-96ac-df9906bdf870 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:31.967980 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816df7af-3a17-4392-bd83-4de1a4f0efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:31.968610 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816df7af-3a17-4392-bd83-4de1a4f0efc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:31.968886 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816df7af-3a17-4392-bd83-4de1a4f0efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:31.969245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816df7af-3a17-4392-bd83-4de1a4f0efc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:31.969879 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816df7af-3a17-4392-bd83-4de1a4f0efc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:31.971497 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816df7af-3a17-4392-bd83-4de1a4f0efc6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:31.981788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1418/2806] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:31.986867 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:31.997498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefb3a3-837d-4257-bd68-01bff1b1e033 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:32.002635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:32.003287 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:32.003557 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:32.003881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] PATH_INFO: `/v3/projects/f3d7d58abdff4236907ce64d6e79d476/users/229d95b8c1e24373a2ea062cc6d4621b/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:32.006210 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d7d58abdff4236907ce64d6e79d476, user_id=229d95b8c1e24373a2ea062cc6d4621b, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:32.008869 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:32.019467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1389/2807] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:31 2022] PUT /identity/v3/projects/f3d7d58abdff4236907ce64d6e79d476/users/229d95b8c1e24373a2ea062cc6d4621b/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:32.031385 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025b81-d3fe-4985-930b-fb442b3f5c37 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:32.031663 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025b81-d3fe-4985-930b-fb442b3f5c37 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:32.031952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025b81-d3fe-4985-930b-fb442b3f5c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:32.064668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-4a025b81-d3fe-4985-930b-fb442b3f5c37 None None] MFA Rules not processed for user `229d95b8c1e24373a2ea062cc6d4621b`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:32.066197 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4a025b81-d3fe-4985-930b-fb442b3f5c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:32.139282 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1419/2808] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:32.151785 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:32.153732 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:32.237518 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05dca-db87-4310-8f78-75e02d1ca47d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:32.241274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:32.241890 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:32.242167 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:32.242433 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:32.251810 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:32.253279 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:32.262910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1390/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:32.348077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025b81-d3fe-4985-930b-fb442b3f5c37 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:32.361680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025b81-d3fe-4985-930b-fb442b3f5c37 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:32.366033 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e010997-de55-4429-aa3f-0a2069f7b84b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:32.366684 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e010997-de55-4429-aa3f-0a2069f7b84b service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:32.366960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e010997-de55-4429-aa3f-0a2069f7b84b service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:32.367223 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e010997-de55-4429-aa3f-0a2069f7b84b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:32.388544 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:32.430721 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e010997-de55-4429-aa3f-0a2069f7b84b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:32.432144 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e010997-de55-4429-aa3f-0a2069f7b84b service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:32.441934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1420/2810] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:39.432901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:39.453852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:39.504419 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafaabf-d2b1-4016-874d-21825680f795 service cinder] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:39.509883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:39.510512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:39.510800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:39.511056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] PATH_INFO: `/v3/users/9d99f878ffbe49fcbc9190f2060c224e` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:39.512264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d99f878ffbe49fcbc9190f2060c224e)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:39.514294 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:39.566248 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d99f878ffbe49fcbc9190f2060c224e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:39.587355 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d99f878ffbe49fcbc9190f2060c224e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:39.588049 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d99f878ffbe49fcbc9190f2060c224e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:39.588690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d99f878ffbe49fcbc9190f2060c224e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:39.596673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d99f878ffbe49fcbc9190f2060c224e'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:39.618906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1391/2811] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:39 2022] DELETE /identity/v3/users/9d99f878ffbe49fcbc9190f2060c224e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:39.624674 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:39.625166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:39.625166 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:39.650785 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:39.652037 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:39.728260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1421/2812] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:39.738372 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:39.739985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:39.827984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb71ef4-b45c-4e3e-8b67-08f721e98a07 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:39.831935 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:39.832553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:39.832823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:39.833089 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:39.842983 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:39.844532 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:39.854566 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1392/2813] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:40.131180 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:40.132897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:40.147578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9bff-d115-415b-aa70-76d56fa1fffc None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:40.154058 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:40.154896 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:40.155271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:40.155898 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] PATH_INFO: `/v3/projects/ab104ec3627d4fd9ab9f2c89a6ae2e26` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:40.157210 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab104ec3627d4fd9ab9f2c89a6ae2e26)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:40.160099 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:40.210408 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab104ec3627d4fd9ab9f2c89a6ae2e26', 'request_id': 'req-244c8f32-4664-42a3-90ca-75637f6f57c3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.219781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab104ec3627d4fd9ab9f2c89a6ae2e26', 'request_id': 'req-244c8f32-4664-42a3-90ca-75637f6f57c3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.225370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab104ec3627d4fd9ab9f2c89a6ae2e26', 'request_id': 'req-244c8f32-4664-42a3-90ca-75637f6f57c3'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.236834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] The token cache is being invalidate because project ab104ec3627d4fd9ab9f2c89a6ae2e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:40.237113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.237747 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.239252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1422/2814] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:40 2022] DELETE /identity/v3/projects/ab104ec3627d4fd9ab9f2c89a6ae2e26 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:40.243385 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:40.253413 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d81b-718f-4b16-9a63-9a858355e75f service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:40.271098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:40.319722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:40.320404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:40.320705 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:40.320988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] PATH_INFO: `/v3/users/229d95b8c1e24373a2ea062cc6d4621b` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:40.322240 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229d95b8c1e24373a2ea062cc6d4621b)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:40.324222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:40.376687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229d95b8c1e24373a2ea062cc6d4621b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.386734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229d95b8c1e24373a2ea062cc6d4621b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.387531 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229d95b8c1e24373a2ea062cc6d4621b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.388217 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229d95b8c1e24373a2ea062cc6d4621b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.395292 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-20b00532-e2d7-4606-851a-2ef4b16a1cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229d95b8c1e24373a2ea062cc6d4621b'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.412550 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1393/2815] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:40 2022] DELETE /identity/v3/users/229d95b8c1e24373a2ea062cc6d4621b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:40.692905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:40.694507 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:40.709643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c8f32-4664-42a3-90ca-75637f6f57c3 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:40.755506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:40.779159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:40.780003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:40.780350 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:40.780743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] PATH_INFO: `/v3/projects/f3d7d58abdff4236907ce64d6e79d476` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:40.782703 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d7d58abdff4236907ce64d6e79d476)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:40.784678 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:40.835519 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d7d58abdff4236907ce64d6e79d476', 'request_id': 'req-e7ba85dc-1478-4536-b59d-1e374586d258'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.844739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d7d58abdff4236907ce64d6e79d476', 'request_id': 'req-e7ba85dc-1478-4536-b59d-1e374586d258'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.851103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d7d58abdff4236907ce64d6e79d476', 'request_id': 'req-e7ba85dc-1478-4536-b59d-1e374586d258'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.863123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] The token cache is being invalidate because project f3d7d58abdff4236907ce64d6e79d476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:40.863400 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.864045 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e7ba85dc-1478-4536-b59d-1e374586d258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:40.865788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1423/2816] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:40 2022] DELETE /identity/v3/projects/f3d7d58abdff4236907ce64d6e79d476 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:40.870698 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2070e2d-1286-4ab7-bb48-cd01c102fa52 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:40.871188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2070e2d-1286-4ab7-bb48-cd01c102fa52 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:40.871291 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2070e2d-1286-4ab7-bb48-cd01c102fa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:40.891679 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-d2070e2d-1286-4ab7-bb48-cd01c102fa52 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:40.892819 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d2070e2d-1286-4ab7-bb48-cd01c102fa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:40.952002 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1394/2817] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:40.959781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1d19-aa91-485f-a4dc-50fdfec96bf5 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:40.960068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1d19-aa91-485f-a4dc-50fdfec96bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:40.960336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1d19-aa91-485f-a4dc-50fdfec96bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:40.980788 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-395d1d19-aa91-485f-a4dc-50fdfec96bf5 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:40.982019 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-395d1d19-aa91-485f-a4dc-50fdfec96bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:40.990059 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1424/2818] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:40.995109 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2070e2d-1286-4ab7-bb48-cd01c102fa52 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.005395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2070e2d-1286-4ab7-bb48-cd01c102fa52 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.010950 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.011689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.012065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.012371 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.013026 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:07:41.013334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.014973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.031350 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1395/2819] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:07:41.033102 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d1d19-aa91-485f-a4dc-50fdfec96bf5 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.042780 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d1d19-aa91-485f-a4dc-50fdfec96bf5 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.048557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.049388 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.049671 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.049931 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.050558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.052494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.082552 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1425/2820] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:41 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:41.086956 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.097506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3382564-651e-4bf9-8bbf-04aacdb64046 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.124603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:41.164215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.164748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.165018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.165281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.165901 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.167871 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.191848 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1396/2821] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:41 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:41.196100 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.207737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37487a9-dbb0-412b-a0b0-7b3cbf4f1abb admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.212806 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.213435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.213752 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.214013 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.214634 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.216255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.226737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1426/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:41.231145 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.241747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930feef0-a1ec-4008-ad28-275b8ab0eb09 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.246580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05569ad2-80eb-4079-a3fd-26453ea8c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.247183 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05569ad2-80eb-4079-a3fd-26453ea8c55f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.247458 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05569ad2-80eb-4079-a3fd-26453ea8c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.247770 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05569ad2-80eb-4079-a3fd-26453ea8c55f admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.248427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05569ad2-80eb-4079-a3fd-26453ea8c55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.250028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05569ad2-80eb-4079-a3fd-26453ea8c55f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.260559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1397/2823] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:41.264941 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.276558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adb16-e06c-4579-9657-5461c19adbd6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.282583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.283136 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.283438 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.283728 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] PATH_INFO: `/v3/projects/6e971c27c5534423bce637140c46d27f/users/2aead00e36ab4c37999de4d10a227898/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.299630 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e971c27c5534423bce637140c46d27f, user_id=2aead00e36ab4c37999de4d10a227898, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.302311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.319296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1427/2824] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:41 2022] PUT /identity/v3/projects/6e971c27c5534423bce637140c46d27f/users/2aead00e36ab4c37999de4d10a227898/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:41.331905 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f170a5-0710-4dd4-9060-8d5c7e49ff9c None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.332194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f170a5-0710-4dd4-9060-8d5c7e49ff9c None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.332457 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f170a5-0710-4dd4-9060-8d5c7e49ff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.364098 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-90f170a5-0710-4dd4-9060-8d5c7e49ff9c None None] MFA Rules not processed for user `2aead00e36ab4c37999de4d10a227898`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:41.365317 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-90f170a5-0710-4dd4-9060-8d5c7e49ff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:41.437435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1398/2825] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:41.441945 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.504022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8db4a-a2df-4b6e-ba1b-42fd32e2012b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.509495 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.510130 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.510401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.510660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.511276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.513235 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.529640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:41.546755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1428/2826] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:41 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:41.551017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f170a5-0710-4dd4-9060-8d5c7e49ff9c None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.562207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f170a5-0710-4dd4-9060-8d5c7e49ff9c None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.634264 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.634876 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.635149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.635412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.636100 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.638071 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.662691 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1399/2827] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:41 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:07:41.666934 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.678348 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d296-16da-46be-a939-fbab8befd47b admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.683488 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.684107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.684396 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.684658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.685296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.686906 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.699051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1429/2828] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:41.703841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.715243 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f8764-a3d4-4234-b6ee-c948fcf55d8a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.720677 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.721346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.721711 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.722257 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] PATH_INFO: `/v3/projects/e4a4e866080f471a91bec538e451d082/users/2932a837f0de4915af9832f796d7d23a/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.737734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a4e866080f471a91bec538e451d082, user_id=2932a837f0de4915af9832f796d7d23a, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.740582 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.753176 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:41.758395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1400/2829] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:41 2022] PUT /identity/v3/projects/e4a4e866080f471a91bec538e451d082/users/2932a837f0de4915af9832f796d7d23a/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:41.762415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.772362 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4a9fd-fef8-4a51-be20-46cb65bc78fa admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.830432 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cf440-a9a3-4009-9dd3-6ecc5af3f254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.831112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf440-a9a3-4009-9dd3-6ecc5af3f254 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.831369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf440-a9a3-4009-9dd3-6ecc5af3f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.831659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf440-a9a3-4009-9dd3-6ecc5af3f254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.832308 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf440-a9a3-4009-9dd3-6ecc5af3f254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.833897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf440-a9a3-4009-9dd3-6ecc5af3f254 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.843643 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1430/2830] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:41.850156 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:41.860886 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464f6a8-d591-46ea-a438-7859af464202 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:41.865701 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:41.866362 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.866636 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.866899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] PATH_INFO: `/v3/projects/e4a4e866080f471a91bec538e451d082/users/2932a837f0de4915af9832f796d7d23a/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.868884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a4e866080f471a91bec538e451d082, user_id=2932a837f0de4915af9832f796d7d23a, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:41.871507 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:41.882402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1401/2831] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:41 2022] PUT /identity/v3/projects/e4a4e866080f471a91bec538e451d082/users/2932a837f0de4915af9832f796d7d23a/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:41.892864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278cda-623c-4031-ae7b-ffc49ca328ba None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:41.893149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278cda-623c-4031-ae7b-ffc49ca328ba None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:41.893766 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278cda-623c-4031-ae7b-ffc49ca328ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:41.923435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-5a278cda-623c-4031-ae7b-ffc49ca328ba None None] MFA Rules not processed for user `2932a837f0de4915af9832f796d7d23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:41.924808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5a278cda-623c-4031-ae7b-ffc49ca328ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:41.999965 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1431/2832] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:42.014800 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:42.017392 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:42.087902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac53e-1cd7-4a8b-8356-ead0d51823b2 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:42.091803 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932ae2a-81c4-4155-8c4e-d7d1b49a450e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:42.092414 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932ae2a-81c4-4155-8c4e-d7d1b49a450e service cinder] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:42.092686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932ae2a-81c4-4155-8c4e-d7d1b49a450e service cinder] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:42.092945 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932ae2a-81c4-4155-8c4e-d7d1b49a450e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:42.102573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932ae2a-81c4-4155-8c4e-d7d1b49a450e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:42.104061 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932ae2a-81c4-4155-8c4e-d7d1b49a450e service cinder] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:42.114149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1402/2833] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:42.147599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a278cda-623c-4031-ae7b-ffc49ca328ba None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:42.216139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a278cda-623c-4031-ae7b-ffc49ca328ba None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:42.222252 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:42.222885 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:42.223157 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:42.223426 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] PATH_INFO: `/v3/users/2aead00e36ab4c37999de4d10a227898` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:42.224673 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aead00e36ab4c37999de4d10a227898)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:42.226692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:42.233003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:42.275716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aead00e36ab4c37999de4d10a227898'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.283403 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aead00e36ab4c37999de4d10a227898'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.291218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aead00e36ab4c37999de4d10a227898'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.291866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aead00e36ab4c37999de4d10a227898'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.304639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aead00e36ab4c37999de4d10a227898'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.313523 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1432/2834] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:42 2022] DELETE /identity/v3/users/2aead00e36ab4c37999de4d10a227898 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:42.318552 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:42.319014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:42.319315 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:42.349620 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:42.350833 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:42.422312 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1403/2835] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:42.433537 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:42.435221 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:42.501303 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6ebe8-2651-4971-9fce-d683a6ebe212 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:42.505522 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:42.506103 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:42.506369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:42.506655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:42.516560 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:42.517986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:42.527839 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1433/2836] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:42.803635 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:42.805284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:42.818140 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40956b40-3414-49a0-8983-02b90df5e01a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:42.823056 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:42.823742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:42.824021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:42.824576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] PATH_INFO: `/v3/projects/6e971c27c5534423bce637140c46d27f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:42.825772 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e971c27c5534423bce637140c46d27f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:42.827767 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:42.884503 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e971c27c5534423bce637140c46d27f', 'request_id': 'req-34430013-e2cf-4a22-ad3c-680b6ec843f4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.893902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e971c27c5534423bce637140c46d27f', 'request_id': 'req-34430013-e2cf-4a22-ad3c-680b6ec843f4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.899500 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e971c27c5534423bce637140c46d27f', 'request_id': 'req-34430013-e2cf-4a22-ad3c-680b6ec843f4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.911007 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] The token cache is being invalidate because project 6e971c27c5534423bce637140c46d27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:42.911306 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.912078 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:42.913690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1404/2837] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:42 2022] DELETE /identity/v3/projects/6e971c27c5534423bce637140c46d27f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:42.917938 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:42.928690 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97161aae-75a0-401b-9933-0dbd794b10d7 service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:42.989971 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:42.990599 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:42.990891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:42.991138 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] PATH_INFO: `/v3/users/2932a837f0de4915af9832f796d7d23a` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:42.992284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2932a837f0de4915af9832f796d7d23a)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:42.994229 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:43.032473 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:43.051140 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2932a837f0de4915af9832f796d7d23a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.061186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2932a837f0de4915af9832f796d7d23a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.076070 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2932a837f0de4915af9832f796d7d23a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.076773 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2932a837f0de4915af9832f796d7d23a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.091489 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1a4aaebc-d88a-4b8d-8a01-ffed3a6dd3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2932a837f0de4915af9832f796d7d23a'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.097976 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1434/2838] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:42 2022] DELETE /identity/v3/users/2932a837f0de4915af9832f796d7d23a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:43.382188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:43.383739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:43.401888 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34430013-e2cf-4a22-ad3c-680b6ec843f4 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:43.412539 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:43.466892 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:43.467527 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.467834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.468106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] PATH_INFO: `/v3/projects/e4a4e866080f471a91bec538e451d082` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.469293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a4e866080f471a91bec538e451d082)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:43.471194 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:43.520883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a4e866080f471a91bec538e451d082', 'request_id': 'req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.530742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a4e866080f471a91bec538e451d082', 'request_id': 'req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.536797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a4e866080f471a91bec538e451d082', 'request_id': 'req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.548209 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] The token cache is being invalidate because project e4a4e866080f471a91bec538e451d082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:43.548491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.549106 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-3d812ebc-0f64-4c5b-be82-7fc6d53a3941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:43.550736 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1405/2839] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:43 2022] DELETE /identity/v3/projects/e4a4e866080f471a91bec538e451d082 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:43.555828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79dd2-3766-4c81-986b-555bcce0682d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.556101 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79dd2-3766-4c81-986b-555bcce0682d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.556369 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e79dd2-3766-4c81-986b-555bcce0682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.577423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-e9e79dd2-3766-4c81-986b-555bcce0682d None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:43.578563 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-e9e79dd2-3766-4c81-986b-555bcce0682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:43.642701 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1435/2840] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:43.650730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03848e54-2d2d-48fe-be86-0a793a9e4f26 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.651015 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03848e54-2d2d-48fe-be86-0a793a9e4f26 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.651284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03848e54-2d2d-48fe-be86-0a793a9e4f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.673674 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-03848e54-2d2d-48fe-be86-0a793a9e4f26 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:43.674900 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-03848e54-2d2d-48fe-be86-0a793a9e4f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:43.684656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1406/2841] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:43.689066 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79dd2-3766-4c81-986b-555bcce0682d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:43.699207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e79dd2-3766-4c81-986b-555bcce0682d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:43.705003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:43.705595 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.706260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.706260 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] PATH_INFO: `/v3/domains` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.706955 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81589) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:07:43.707250 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:43.708877 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:43.720326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1436/2842] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:07:43.725319 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03848e54-2d2d-48fe-be86-0a793a9e4f26 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:43.735398 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03848e54-2d2d-48fe-be86-0a793a9e4f26 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:43.741447 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:43.742050 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.742322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.742590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.743215 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:43.745164 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:43.776976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1407/2843] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:43 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:43.781418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:43.792337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4364a7-e073-4177-8b56-3e4ceb71999c admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:43.852110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:43.852714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.852987 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.853253 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.853887 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:43.855832 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:43.884326 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1437/2844] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:43 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:07:43.890547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:43.901807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dcbe6-7794-4e2b-8d77-0a2e6d5570fb admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:43.907485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:43.908207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.908483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.908748 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.909383 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:43.911229 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:43.922874 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1408/2845] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:43.927771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:43.938264 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13d570-d92e-4578-9fb7-435afa07b8fe admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:43.942994 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edfdbd-bb5e-42cf-a02a-0f98d270b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:43.943586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edfdbd-bb5e-42cf-a02a-0f98d270b281 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.943889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edfdbd-bb5e-42cf-a02a-0f98d270b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.944153 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edfdbd-bb5e-42cf-a02a-0f98d270b281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.944782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edfdbd-bb5e-42cf-a02a-0f98d270b281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:43.946361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edfdbd-bb5e-42cf-a02a-0f98d270b281 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:43.958714 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1438/2846] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:43.963047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:43.973401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e3c2-88ed-41fe-8727-4812aec23edb admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:43.978499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:43.979151 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:43.979451 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:43.979746 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] PATH_INFO: `/v3/projects/f9543838491246be959ff9c0e48ed6ac/users/50b885ff79004d14a0be55cf970c12d6/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:43.996922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9543838491246be959ff9c0e48ed6ac, user_id=50b885ff79004d14a0be55cf970c12d6, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.001080 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.021493 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1409/2847] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:43 2022] PUT /identity/v3/projects/f9543838491246be959ff9c0e48ed6ac/users/50b885ff79004d14a0be55cf970c12d6/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:44.099818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f18498-948a-4d27-a01a-8c0745ce56f1 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.100083 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f18498-948a-4d27-a01a-8c0745ce56f1 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.100346 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f18498-948a-4d27-a01a-8c0745ce56f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.130872 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:44.134463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-84f18498-948a-4d27-a01a-8c0745ce56f1 None None] MFA Rules not processed for user `50b885ff79004d14a0be55cf970c12d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:44.136191 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-84f18498-948a-4d27-a01a-8c0745ce56f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:44.215688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1439/2848] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:44.220535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:44.267195 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:44.291092 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d615b-ce32-40c1-986f-2ac237e421ba admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:44.296919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:44.297528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.297804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.298067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.298690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.301079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.337669 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1410/2849] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:44 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:44.342629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f18498-948a-4d27-a01a-8c0745ce56f1 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:44.355820 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f18498-948a-4d27-a01a-8c0745ce56f1 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:44.426370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:44.426894 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.427167 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.427433 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.428082 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.430156 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.460573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1440/2850] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:44 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:44.464837 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:44.476585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f698-f759-4f2a-8e6f-fb5aaa7ef1e5 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:44.482470 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:44.483101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.483366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.483661 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.484324 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.485932 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.501979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1411/2851] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:44.506339 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:44.516559 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd019-4ed5-4766-99ee-255906af03d6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:44.521727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:44.522377 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.522647 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.522911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] PATH_INFO: `/v3/projects/0be598327de04837846ec782e500af78/users/47d561c9dc274c4f9c8ad1949a2136ec/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.538448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be598327de04837846ec782e500af78, user_id=47d561c9dc274c4f9c8ad1949a2136ec, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.541133 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.556276 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1441/2852] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:44 2022] PUT /identity/v3/projects/0be598327de04837846ec782e500af78/users/47d561c9dc274c4f9c8ad1949a2136ec/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:44.560222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:44.570497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4744dfb-cc14-4205-b953-f75bf18dfa02 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:44.629534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118718-e1c8-4edb-8456-8f201b449d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:44.630211 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118718-e1c8-4edb-8456-8f201b449d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.630490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118718-e1c8-4edb-8456-8f201b449d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.630763 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118718-e1c8-4edb-8456-8f201b449d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.631415 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118718-e1c8-4edb-8456-8f201b449d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.633064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118718-e1c8-4edb-8456-8f201b449d11 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.643903 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1412/2853] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:44.648401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:44.659001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f667e7-efba-4785-bd78-a88e96ad9919 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:44.664337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:44.664993 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.665272 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.665668 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] PATH_INFO: `/v3/projects/0be598327de04837846ec782e500af78/users/47d561c9dc274c4f9c8ad1949a2136ec/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.667798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be598327de04837846ec782e500af78, user_id=47d561c9dc274c4f9c8ad1949a2136ec, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.670441 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.681672 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1442/2854] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:44 2022] PUT /identity/v3/projects/0be598327de04837846ec782e500af78/users/47d561c9dc274c4f9c8ad1949a2136ec/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:44.692386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1e8c-4c70-494e-a6b9-e0a646b22fd5 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.692665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1e8c-4c70-494e-a6b9-e0a646b22fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.692955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b1e8c-4c70-494e-a6b9-e0a646b22fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.723434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-617b1e8c-4c70-494e-a6b9-e0a646b22fd5 None None] MFA Rules not processed for user `47d561c9dc274c4f9c8ad1949a2136ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:44.724757 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-617b1e8c-4c70-494e-a6b9-e0a646b22fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:44.808535 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1413/2855] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:44.820505 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:44.823444 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:44.891169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760a69-8e13-472a-bed1-fa000397d3ff admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:44.897311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b28b4-7264-4582-8348-7475b061c4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:44.897952 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b28b4-7264-4582-8348-7475b061c4cc service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:44.898174 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b28b4-7264-4582-8348-7475b061c4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:44.898418 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b28b4-7264-4582-8348-7475b061c4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:44.909378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b28b4-7264-4582-8348-7475b061c4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:44.910835 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b28b4-7264-4582-8348-7475b061c4cc service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:44.914709 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:44.922126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1443/2856] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:45.313498 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b1e8c-4c70-494e-a6b9-e0a646b22fd5 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:45.355174 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:45.388181 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b1e8c-4c70-494e-a6b9-e0a646b22fd5 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:45.394483 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:45.395144 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:45.395421 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:45.395690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] PATH_INFO: `/v3/users/50b885ff79004d14a0be55cf970c12d6` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:45.396873 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b885ff79004d14a0be55cf970c12d6)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:45.398839 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:45.449045 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b885ff79004d14a0be55cf970c12d6'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:45.458673 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b885ff79004d14a0be55cf970c12d6'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:45.459530 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b885ff79004d14a0be55cf970c12d6'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:45.460416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b885ff79004d14a0be55cf970c12d6'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:45.467303 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b885ff79004d14a0be55cf970c12d6'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:45.495027 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1414/2857] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:45 2022] DELETE /identity/v3/users/50b885ff79004d14a0be55cf970c12d6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:45.499853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:45.500376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:45.500376 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:45.519822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:45.521000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:45.581822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1444/2858] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:45.593592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:45.595754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:45.656655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf92fd-f35d-4d2d-bee5-7baf0f5a5d57 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:45.660865 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:45.661473 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:45.661781 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:45.662044 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:45.671479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:45.672948 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:45.682576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1415/2859] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:45.960414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:45.961957 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:45.976692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a7b49-89d8-426c-9810-cda001990bc1 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:45.982110 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:45.982923 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:45.983288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:45.983475 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] PATH_INFO: `/v3/projects/f9543838491246be959ff9c0e48ed6ac` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:45.984905 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9543838491246be959ff9c0e48ed6ac)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:45.987246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:46.036584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9543838491246be959ff9c0e48ed6ac', 'request_id': 'req-bf8078a9-41de-41d1-bac3-99bde4868f32'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.053015 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9543838491246be959ff9c0e48ed6ac', 'request_id': 'req-bf8078a9-41de-41d1-bac3-99bde4868f32'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.062698 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9543838491246be959ff9c0e48ed6ac', 'request_id': 'req-bf8078a9-41de-41d1-bac3-99bde4868f32'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.075524 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] The token cache is being invalidate because project f9543838491246be959ff9c0e48ed6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:46.075828 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.076570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.078149 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1445/2860] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:45 2022] DELETE /identity/v3/projects/f9543838491246be959ff9c0e48ed6ac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:46.082921 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:46.097101 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4dad5-9b8c-4b6d-9df5-b686ea3c5bf9 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:46.147714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:46.155465 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:46.156124 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:46.156406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:46.156686 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] PATH_INFO: `/v3/users/47d561c9dc274c4f9c8ad1949a2136ec` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:46.157882 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d561c9dc274c4f9c8ad1949a2136ec)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:46.161005 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:46.212504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d561c9dc274c4f9c8ad1949a2136ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.221910 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d561c9dc274c4f9c8ad1949a2136ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.222666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d561c9dc274c4f9c8ad1949a2136ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.223374 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d561c9dc274c4f9c8ad1949a2136ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.231490 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-02908c70-1c76-42b2-8d03-fe073b6dcbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d561c9dc274c4f9c8ad1949a2136ec'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.250064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1416/2861] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:46 2022] DELETE /identity/v3/users/47d561c9dc274c4f9c8ad1949a2136ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:46.542716 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:46.544269 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:46.562662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8078a9-41de-41d1-bac3-99bde4868f32 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:46.621293 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:46.621848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:46.622121 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:46.622387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] PATH_INFO: `/v3/projects/0be598327de04837846ec782e500af78` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:46.623491 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be598327de04837846ec782e500af78)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:46.625442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:46.649564 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:46.674676 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be598327de04837846ec782e500af78', 'request_id': 'req-e30e6022-41c8-4251-a503-25b4b506e764'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.684657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be598327de04837846ec782e500af78', 'request_id': 'req-e30e6022-41c8-4251-a503-25b4b506e764'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.690715 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be598327de04837846ec782e500af78', 'request_id': 'req-e30e6022-41c8-4251-a503-25b4b506e764'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.702727 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] The token cache is being invalidate because project 0be598327de04837846ec782e500af78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:46.703016 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.703756 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-e30e6022-41c8-4251-a503-25b4b506e764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:46.705354 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1446/2862] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:46 2022] DELETE /identity/v3/projects/0be598327de04837846ec782e500af78 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:46.710491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc09d-1cc9-405a-ad1f-c45808f59406 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:46.711018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc09d-1cc9-405a-ad1f-c45808f59406 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:46.711018 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc09d-1cc9-405a-ad1f-c45808f59406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:46.731171 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-8d3cc09d-1cc9-405a-ad1f-c45808f59406 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:46.732404 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-8d3cc09d-1cc9-405a-ad1f-c45808f59406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:46.811825 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1417/2863] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:46.821035 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac600f-141c-466b-8c1a-b953997d2b34 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:46.821317 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac600f-141c-466b-8c1a-b953997d2b34 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:46.821581 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac600f-141c-466b-8c1a-b953997d2b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:46.844358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-c2ac600f-141c-466b-8c1a-b953997d2b34 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:46.845571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c2ac600f-141c-466b-8c1a-b953997d2b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:46.855053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1447/2864] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:46.861583 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cc09d-1cc9-405a-ad1f-c45808f59406 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:46.872020 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cc09d-1cc9-405a-ad1f-c45808f59406 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:46.877526 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:46.878155 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:46.878429 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:46.878693 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:46.879344 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:07:46.879633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:46.881284 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:46.896975 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1418/2865] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:07:46.899051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac600f-141c-466b-8c1a-b953997d2b34 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:46.914077 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac600f-141c-466b-8c1a-b953997d2b34 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:46.921883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:46.922506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:46.922805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:46.923093 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:46.923739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:46.925944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:46.958370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1448/2866] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:46 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:46.963406 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:46.978850 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035bed-a3ac-494f-a107-80f96865898f admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:47.039714 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:47.040361 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.040621 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.040866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.041489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:47.043386 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:47.053722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:47.069722 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1419/2867] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:46 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:07:47.073889 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:47.084679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ff965-161d-49e8-9f41-498d26c0c262 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:47.090492 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:47.091107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.091476 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.091758 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.092390 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:47.093989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:47.105327 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1449/2868] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:47.109463 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:47.119829 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e8eaa-6850-4377-bbb5-cb0ad27a0a43 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:47.124445 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f9243-649d-438b-95a0-3cc8791aa3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:47.124973 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9243-649d-438b-95a0-3cc8791aa3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.125242 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9243-649d-438b-95a0-3cc8791aa3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.125502 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9243-649d-438b-95a0-3cc8791aa3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.126132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f9243-649d-438b-95a0-3cc8791aa3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:47.127783 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f9243-649d-438b-95a0-3cc8791aa3b3 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:47.138381 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1420/2869] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:47.142746 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:47.152861 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18a53-3bda-4b92-b073-dd7cf4a0cdee admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:47.157819 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:47.158450 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.158718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.158979 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] PATH_INFO: `/v3/projects/9b094fcc0c48413aaf1dd8b4d8cecb3a/users/ced73653fa9e4b9da5c944f50ee192d4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.173953 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b094fcc0c48413aaf1dd8b4d8cecb3a, user_id=ced73653fa9e4b9da5c944f50ee192d4, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:47.176790 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:47.195482 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1450/2870] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:47 2022] PUT /identity/v3/projects/9b094fcc0c48413aaf1dd8b4d8cecb3a/users/ced73653fa9e4b9da5c944f50ee192d4/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:07:47.208081 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299f3c-ac25-449a-a6d4-75fdf2d09274 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.208387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299f3c-ac25-449a-a6d4-75fdf2d09274 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.208656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299f3c-ac25-449a-a6d4-75fdf2d09274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.237889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-4c299f3c-ac25-449a-a6d4-75fdf2d09274 None None] MFA Rules not processed for user `ced73653fa9e4b9da5c944f50ee192d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:47.239133 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-4c299f3c-ac25-449a-a6d4-75fdf2d09274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:47.305899 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1421/2871] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:07:47.317518 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:47.319331 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:47.377441 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68a406-2a21-4250-9ff2-4933436c8907 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:47.382002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8b820-4dee-436a-ae4f-b345a8b7c3e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:47.382592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b820-4dee-436a-ae4f-b345a8b7c3e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.382866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b820-4dee-436a-ae4f-b345a8b7c3e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.383119 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b820-4dee-436a-ae4f-b345a8b7c3e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.392051 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8b820-4dee-436a-ae4f-b345a8b7c3e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:47.393589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8b820-4dee-436a-ae4f-b345a8b7c3e4 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:47.404340 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1451/2872] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:47.429024 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299f3c-ac25-449a-a6d4-75fdf2d09274 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:47.496064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299f3c-ac25-449a-a6d4-75fdf2d09274 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:47.501467 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:47.502093 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.502366 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.502632 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] PATH_INFO: `/v3/users/ced73653fa9e4b9da5c944f50ee192d4` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.503889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced73653fa9e4b9da5c944f50ee192d4)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:47.505778 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:47.558496 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced73653fa9e4b9da5c944f50ee192d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:47.568459 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced73653fa9e4b9da5c944f50ee192d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:47.569216 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced73653fa9e4b9da5c944f50ee192d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:47.569897 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced73653fa9e4b9da5c944f50ee192d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:47.577906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced73653fa9e4b9da5c944f50ee192d4'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:47.586460 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:47.600602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1422/2873] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:07:47 2022] DELETE /identity/v3/users/ced73653fa9e4b9da5c944f50ee192d4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:47.605290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.605779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.605779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.625558 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:47.626749 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:47.675001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:47.692209 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1452/2874] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:47.702807 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:47.704269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:47.762189 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eed24e-9828-4d17-b591-ccdb8796a320 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:47.766690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917c0dc-4e05-4d78-bc58-38fd6cf56bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:47.767289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c0dc-4e05-4d78-bc58-38fd6cf56bbe service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:47.767562 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c0dc-4e05-4d78-bc58-38fd6cf56bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:47.767858 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c0dc-4e05-4d78-bc58-38fd6cf56bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:47.777650 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917c0dc-4e05-4d78-bc58-38fd6cf56bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:47.779065 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917c0dc-4e05-4d78-bc58-38fd6cf56bbe service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:47.788613 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1423/2875] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:07:48.087914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.089415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:48.103095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5981db0-905b-4ef9-8be2-c08997eb67c6 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.109284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.109929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.110188 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.110470 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] PATH_INFO: `/v3/projects/9b094fcc0c48413aaf1dd8b4d8cecb3a` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.111795 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b094fcc0c48413aaf1dd8b4d8cecb3a)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.113679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.162981 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b094fcc0c48413aaf1dd8b4d8cecb3a', 'request_id': 'req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:48.172572 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b094fcc0c48413aaf1dd8b4d8cecb3a', 'request_id': 'req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:48.178416 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b094fcc0c48413aaf1dd8b4d8cecb3a', 'request_id': 'req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:48.189700 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] The token cache is being invalidate because project 9b094fcc0c48413aaf1dd8b4d8cecb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:07:48.189916 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:48.190902 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-66e6e0a5-0c21-4d6c-9322-f4c6945a0313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:07:48.192465 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1453/2876] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:07:48 2022] DELETE /identity/v3/projects/9b094fcc0c48413aaf1dd8b4d8cecb3a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:48.197516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1872c-8c3b-46ce-bc61-49d7b10784ba None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.197775 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1872c-8c3b-46ce-bc61-49d7b10784ba None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.198039 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1872c-8c3b-46ce-bc61-49d7b10784ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.219418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-04c1872c-8c3b-46ce-bc61-49d7b10784ba None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:48.220641 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-04c1872c-8c3b-46ce-bc61-49d7b10784ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:48.287555 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1424/2877] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:48.295692 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105658b9-a2aa-442d-b21a-dac3846cdaae None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.296004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105658b9-a2aa-442d-b21a-dac3846cdaae None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.296271 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105658b9-a2aa-442d-b21a-dac3846cdaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.317338 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-105658b9-a2aa-442d-b21a-dac3846cdaae None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:48.318536 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-105658b9-a2aa-442d-b21a-dac3846cdaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:48.327246 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1454/2878] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:48.332147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1872c-8c3b-46ce-bc61-49d7b10784ba None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.342592 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1872c-8c3b-46ce-bc61-49d7b10784ba None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.348448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.349048 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.349318 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.349576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.350191 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:07:48.350488 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.352136 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.366143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1425/2879] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 13:07:48.371014 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105658b9-a2aa-442d-b21a-dac3846cdaae None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.381245 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105658b9-a2aa-442d-b21a-dac3846cdaae None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.387139 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.387817 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.388095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.388361 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.388989 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.390909 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.421291 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1455/2880] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:07:48 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:07:48.425666 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.436077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a0fe1-6ccf-49df-b6bb-01be9849fcbc admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.497612 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.498222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.498474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.498764 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.499400 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.501388 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.528779 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1426/2881] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:07:48 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:07:48.533401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.548337 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba6b8-090b-413e-b4b0-3bc4832ba7f6 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.554401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.555040 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.555311 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.555584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.556270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.558104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.569092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1456/2882] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:48.573321 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.584334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2fafd-4043-4898-b2a2-79c8826919ce admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.589918 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e4321-a778-4ad3-a6e1-7da3bac46bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.590523 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e4321-a778-4ad3-a6e1-7da3bac46bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.590797 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e4321-a778-4ad3-a6e1-7da3bac46bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.591064 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e4321-a778-4ad3-a6e1-7da3bac46bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.591727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e4321-a778-4ad3-a6e1-7da3bac46bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.593338 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e4321-a778-4ad3-a6e1-7da3bac46bf3 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.599256 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:48.605689 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1427/2883] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:07:48.610038 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.620397 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e645-6311-4338-baee-b4a27153322d admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.625192 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.625854 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.626132 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.626401 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] PATH_INFO: `/v3/projects/e292904ac920476697aab12db0885939/users/dde9e9369227453aa70d6e32b8580ae7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.641510 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e292904ac920476697aab12db0885939, user_id=dde9e9369227453aa70d6e32b8580ae7, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.644356 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.659366 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1457/2884] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:07:48 2022] PUT /identity/v3/projects/e292904ac920476697aab12db0885939/users/dde9e9369227453aa70d6e32b8580ae7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:07:48.671180 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061d9a0-2df9-4764-8a0b-cafe60690560 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.671464 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061d9a0-2df9-4764-8a0b-cafe60690560 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.671733 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061d9a0-2df9-4764-8a0b-cafe60690560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.702559 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-a061d9a0-2df9-4764-8a0b-cafe60690560 None None] MFA Rules not processed for user `dde9e9369227453aa70d6e32b8580ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:07:48.703747 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-a061d9a0-2df9-4764-8a0b-cafe60690560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:48.770902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1428/2885] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:07:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:07:48.783302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:07:48.785254 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:07:48.861290 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239355a4-ef9d-4488-a101-f2c92906d8cd admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:07:48.868651 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb847e3-d34d-40b1-acc5-c38afde6f8dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:07:48.869542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb847e3-d34d-40b1-acc5-c38afde6f8dc service glance] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:07:48.869829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb847e3-d34d-40b1-acc5-c38afde6f8dc service glance] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:07:48.870217 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb847e3-d34d-40b1-acc5-c38afde6f8dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:07:48.882978 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb847e3-d34d-40b1-acc5-c38afde6f8dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:07:48.884534 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb847e3-d34d-40b1-acc5-c38afde6f8dc service glance] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:07:48.894053 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1458/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:07:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:07:58.767966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=32 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:07:58.889583 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:02.437337 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061d9a0-2df9-4764-8a0b-cafe60690560 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:02.506603 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061d9a0-2df9-4764-8a0b-cafe60690560 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:02.513175 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:02.513817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:02.514129 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:02.514389 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] PATH_INFO: `/v3/users/dde9e9369227453aa70d6e32b8580ae7` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:02.515758 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde9e9369227453aa70d6e32b8580ae7)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:02.518553 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:02.572961 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde9e9369227453aa70d6e32b8580ae7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:02.582491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde9e9369227453aa70d6e32b8580ae7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:02.583143 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde9e9369227453aa70d6e32b8580ae7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:02.583866 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde9e9369227453aa70d6e32b8580ae7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:02.591079 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde9e9369227453aa70d6e32b8580ae7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:02.608588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1429/2887] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:08:02 2022] DELETE /identity/v3/users/dde9e9369227453aa70d6e32b8580ae7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:08:02.613486 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:02.614007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:02.614007 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:02.641165 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:02.642804 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:02.706080 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1459/2888] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 13:08:02.716401 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:02.717889 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:02.779182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469772c6-1835-458f-909e-7ac6cb0037ba admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:02.783281 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc06f9-9fd0-4c61-954f-f20df426d3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:02.783929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc06f9-9fd0-4c61-954f-f20df426d3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:02.784205 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc06f9-9fd0-4c61-954f-f20df426d3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:02.784471 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc06f9-9fd0-4c61-954f-f20df426d3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:02.793906 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc06f9-9fd0-4c61-954f-f20df426d3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:02.795331 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc06f9-9fd0-4c61-954f-f20df426d3a8 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:02.804916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1430/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:03.081829 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.083586 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:03.096573 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af848410-4cba-4f86-a7c6-ad431c4aa3f0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.101984 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.102822 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.103096 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.103378 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] PATH_INFO: `/v3/projects/e292904ac920476697aab12db0885939` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.104650 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e292904ac920476697aab12db0885939)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.106608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.158929 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e292904ac920476697aab12db0885939', 'request_id': 'req-d27c3d26-9402-4d8f-8b48-76be034f7fdf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:03.169057 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e292904ac920476697aab12db0885939', 'request_id': 'req-d27c3d26-9402-4d8f-8b48-76be034f7fdf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:03.174659 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e292904ac920476697aab12db0885939', 'request_id': 'req-d27c3d26-9402-4d8f-8b48-76be034f7fdf'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:03.185764 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] The token cache is being invalidate because project e292904ac920476697aab12db0885939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:08:03.186047 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:03.186688 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-d27c3d26-9402-4d8f-8b48-76be034f7fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:03.188292 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1460/2890] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:08:03 2022] DELETE /identity/v3/projects/e292904ac920476697aab12db0885939 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:08:03.193236 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad14f-42b1-4958-a9ea-5500cae21bc7 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.193519 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad14f-42b1-4958-a9ea-5500cae21bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.193789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad14f-42b1-4958-a9ea-5500cae21bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.215859 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-089ad14f-42b1-4958-a9ea-5500cae21bc7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:03.217077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-089ad14f-42b1-4958-a9ea-5500cae21bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:03.235448 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:03.280438 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1431/2891] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:03.288373 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4577-39ba-4352-91bd-226daaed47f3 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.288657 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4577-39ba-4352-91bd-226daaed47f3 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.288922 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4577-39ba-4352-91bd-226daaed47f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.310520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-030f4577-39ba-4352-91bd-226daaed47f3 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:03.311725 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-030f4577-39ba-4352-91bd-226daaed47f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:03.321748 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1461/2892] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:03.326716 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ad14f-42b1-4958-a9ea-5500cae21bc7 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.337193 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ad14f-42b1-4958-a9ea-5500cae21bc7 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.342808 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.343418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.343688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.343985 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.344625 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:08:03.344922 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.346521 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.359595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1432/2893] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:08:03.364437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f4577-39ba-4352-91bd-226daaed47f3 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.374944 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f4577-39ba-4352-91bd-226daaed47f3 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.380075 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.380679 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.380956 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.381224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.381818 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.383757 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.417913 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1462/2894] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:08:03 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:08:03.424643 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.437442 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a94cdf-de2e-4019-ad55-2575a41ab52e admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.496547 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.497149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.497422 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.497688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.498322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.500263 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.524499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1433/2895] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:08:03 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:08:03.528706 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.538947 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f830f-360c-421e-b6ec-3419ef146842 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.543858 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.544459 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.544733 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.545003 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.545642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.547244 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.557437 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1463/2896] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:08:03.561622 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.572000 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f74d0d-a0f7-4d14-8986-d3b9e3bf3f27 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.577474 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332675a4-b98f-4051-88f9-c7b96cf58db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.578072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332675a4-b98f-4051-88f9-c7b96cf58db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.578347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332675a4-b98f-4051-88f9-c7b96cf58db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.578614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332675a4-b98f-4051-88f9-c7b96cf58db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.579274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332675a4-b98f-4051-88f9-c7b96cf58db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.580916 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332675a4-b98f-4051-88f9-c7b96cf58db3 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.591731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1434/2897] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:08:03.595974 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.606107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efd91e-970c-45fa-87ee-3158c1c13108 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.611164 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.611857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.612141 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.612387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] PATH_INFO: `/v3/projects/6fe7c2994ee24c86b20b24c4ae493b85/users/8b6373a807464e98a0791455a15c7da7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.628939 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe7c2994ee24c86b20b24c4ae493b85, user_id=8b6373a807464e98a0791455a15c7da7, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.631626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.649073 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1464/2898] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:08:03 2022] PUT /identity/v3/projects/6fe7c2994ee24c86b20b24c4ae493b85/users/8b6373a807464e98a0791455a15c7da7/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:08:03.659546 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbba4c-3cbe-47fb-a9b4-90e4e9ba4e17 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.659852 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbba4c-3cbe-47fb-a9b4-90e4e9ba4e17 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.660121 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbba4c-3cbe-47fb-a9b4-90e4e9ba4e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.688614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-57dbba4c-3cbe-47fb-a9b4-90e4e9ba4e17 None None] MFA Rules not processed for user `8b6373a807464e98a0791455a15c7da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:03.689726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-57dbba4c-3cbe-47fb-a9b4-90e4e9ba4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:03.764495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1435/2899] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:03.778159 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:03.780195 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:03.808783 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:03.852940 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f917ef9-f6f5-4b6b-9633-3e2d57a776b8 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:03.857648 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f714d8a-3e7c-4ae6-8453-fca170641678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faee06d60a484eebb6a9fb31ce0878d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:03.858268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714d8a-3e7c-4ae6-8453-fca170641678 service cinder] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:03.858542 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714d8a-3e7c-4ae6-8453-fca170641678 service cinder] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:03.858803 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f714d8a-3e7c-4ae6-8453-fca170641678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:03.869463 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714d8a-3e7c-4ae6-8453-fca170641678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:03.870911 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f714d8a-3e7c-4ae6-8453-fca170641678 service cinder] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:03.880760 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1465/2900] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:09.319830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbba4c-3cbe-47fb-a9b4-90e4e9ba4e17 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:09.341267 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:09.386353 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbba4c-3cbe-47fb-a9b4-90e4e9ba4e17 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:09.391328 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:09.391988 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:09.392268 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:09.392534 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] PATH_INFO: `/v3/users/8b6373a807464e98a0791455a15c7da7` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:09.393707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6373a807464e98a0791455a15c7da7)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:09.395624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:09.449567 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6373a807464e98a0791455a15c7da7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:09.458023 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6373a807464e98a0791455a15c7da7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:09.458655 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6373a807464e98a0791455a15c7da7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:09.459293 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6373a807464e98a0791455a15c7da7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:09.466814 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6373a807464e98a0791455a15c7da7'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:09.484990 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1436/2901] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:08:09 2022] DELETE /identity/v3/users/8b6373a807464e98a0791455a15c7da7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:08:09.489655 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:09.490137 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:09.490234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:09.509958 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:09.511243 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:09.572807 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1466/2902] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:09.582995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:09.584428 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:09.642902 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e38662-1688-4a9e-843a-6b2168986301 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:09.647112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99912445-1929-4319-9d93-8487fba807c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:09.647739 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912445-1929-4319-9d93-8487fba807c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:09.648031 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912445-1929-4319-9d93-8487fba807c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:09.648298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99912445-1929-4319-9d93-8487fba807c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:09.658222 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99912445-1929-4319-9d93-8487fba807c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:09.659665 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99912445-1929-4319-9d93-8487fba807c7 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:09.669336 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1437/2903] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:09.944942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:09.948278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:09.968330 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bc8d8-ff83-451b-bc2b-fbc2c4465ad0 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:09.974660 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:09.975287 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:09.975533 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:09.975836 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] PATH_INFO: `/v3/projects/6fe7c2994ee24c86b20b24c4ae493b85` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:09.977118 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe7c2994ee24c86b20b24c4ae493b85)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:09.979266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.034771 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe7c2994ee24c86b20b24c4ae493b85', 'request_id': 'req-1c47b1ae-886e-45f2-8044-d482fe687447'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:10.044640 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe7c2994ee24c86b20b24c4ae493b85', 'request_id': 'req-1c47b1ae-886e-45f2-8044-d482fe687447'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:10.050224 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe7c2994ee24c86b20b24c4ae493b85', 'request_id': 'req-1c47b1ae-886e-45f2-8044-d482fe687447'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:10.061781 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] The token cache is being invalidate because project 6fe7c2994ee24c86b20b24c4ae493b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81589) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:08:10.062067 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:10.062686 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-1c47b1ae-886e-45f2-8044-d482fe687447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:08:10.064238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1467/2904] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:08:09 2022] DELETE /identity/v3/projects/6fe7c2994ee24c86b20b24c4ae493b85 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:08:10.069347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c87e-bd9e-42d3-856a-f0e78f4fe95a None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.069628 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c87e-bd9e-42d3-856a-f0e78f4fe95a None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.069891 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c87e-bd9e-42d3-856a-f0e78f4fe95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.091427 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-3061c87e-bd9e-42d3-856a-f0e78f4fe95a None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:10.092585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-3061c87e-bd9e-42d3-856a-f0e78f4fe95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:10.129043 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:10.158178 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1438/2905] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:10.171147 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93cb1-4caf-4575-a298-988e3bf325c7 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.171423 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93cb1-4caf-4575-a298-988e3bf325c7 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.171689 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93cb1-4caf-4575-a298-988e3bf325c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.192589 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-37e93cb1-4caf-4575-a298-988e3bf325c7 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:10.193797 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-37e93cb1-4caf-4575-a298-988e3bf325c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:10.203186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1468/2906] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:10.207528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c87e-bd9e-42d3-856a-f0e78f4fe95a None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:10.218342 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c87e-bd9e-42d3-856a-f0e78f4fe95a None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:10.223929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:10.224529 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.224805 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.225072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.225709 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81588) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 13:08:10.226004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:10.227602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.242984 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1439/2907] 10.222.0.42 () {58 vars in 1153 bytes} [Thu Sep 15 13:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 13:08:10.247623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e93cb1-4caf-4575-a298-988e3bf325c7 None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:10.257071 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e93cb1-4caf-4575-a298-988e3bf325c7 None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:10.262629 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:10.263232 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.263506 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.263798 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.264415 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:10.266322 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.303800 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1469/2908] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:08:10 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:08:10.305815 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:10.320789 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3856e4e-c8b2-4a7e-9238-2cb732dd4dfc admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:10.384600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:10.385238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.385513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.385780 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.386435 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:10.388346 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.415038 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1440/2909] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:08:10 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:08:10.419893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:10.431914 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fb581-5ef5-453f-b340-be41a37a5651 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:10.437169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:10.437816 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.438092 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.438358 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.438998 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:10.440652 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.452318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1470/2910] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:08:10.456727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:10.467656 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153b28-4960-4dbc-bef0-a5ee747f08e1 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:10.473577 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52223c-45e1-4859-89ff-3b1b1ccb7b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:10.474204 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52223c-45e1-4859-89ff-3b1b1ccb7b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.474484 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52223c-45e1-4859-89ff-3b1b1ccb7b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.474754 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52223c-45e1-4859-89ff-3b1b1ccb7b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.475394 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52223c-45e1-4859-89ff-3b1b1ccb7b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:10.477057 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52223c-45e1-4859-89ff-3b1b1ccb7b36 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.488402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1441/2911] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:08:10.492875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:10.503446 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45560839-cd4b-4071-a6ad-d86b1d581089 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:10.508442 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:10.509169 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] REQUEST_METHOD: `PUT` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.509448 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.509710 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] PATH_INFO: `/v3/projects/73320feb45d641888a60994b0955a7e0/users/ffd78b89e2a646d1b34d5358c84696c6/roles/49776df6eca74fe69bb7b4b1a3cfb7cd` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.512126 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:10.528336 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73320feb45d641888a60994b0955a7e0, user_id=ffd78b89e2a646d1b34d5358c84696c6, role_id=49776df6eca74fe69bb7b4b1a3cfb7cd)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:10.530999 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.550367 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1471/2912] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:08:10 2022] PUT /identity/v3/projects/73320feb45d641888a60994b0955a7e0/users/ffd78b89e2a646d1b34d5358c84696c6/roles/49776df6eca74fe69bb7b4b1a3cfb7cd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:08:10.557147 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d57fe-edde-4cd1-945e-d9296f3b0661 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.557434 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d57fe-edde-4cd1-945e-d9296f3b0661 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.557726 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d57fe-edde-4cd1-945e-d9296f3b0661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.579444 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b02d57fe-edde-4cd1-945e-d9296f3b0661 None None] MFA Rules not processed for user `e74cf16638b84fdcb3063b017c210c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:10.580821 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b02d57fe-edde-4cd1-945e-d9296f3b0661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:10.642128 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1442/2913] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:10.652435 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:10.654341 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:10.717891 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92956e87-7b97-41de-90fd-54758ef4a360 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:10.728808 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:10.729740 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:10.730095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:10.730436 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:10.745478 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:10.746926 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:10.765883 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1472/2914] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:14.588072 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35c2b-eda1-461e-91f1-a7a5917ba523 None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:14.588742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35c2b-eda1-461e-91f1-a7a5917ba523 None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:14.588742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd35c2b-eda1-461e-91f1-a7a5917ba523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:14.626416 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-fcd35c2b-eda1-461e-91f1-a7a5917ba523 None None] MFA Rules not processed for user `ffd78b89e2a646d1b34d5358c84696c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:14.627505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-fcd35c2b-eda1-461e-91f1-a7a5917ba523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:14.667235 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:14.701668 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1443/2915] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:14.706255 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:14.716739 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd025-f38e-4450-8dfd-9ec91554ee5e service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:14.721511 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:14.722193 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:14.722539 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:14.722875 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:14.723584 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:14.725602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:14.754623 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1473/2916] 10.222.0.42 () {60 vars in 1153 bytes} [Thu Sep 15 13:08:14 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 13:08:14.758939 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35c2b-eda1-461e-91f1-a7a5917ba523 None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:14.770359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd35c2b-eda1-461e-91f1-a7a5917ba523 None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:14.830834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:14.831485 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:14.831787 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:14.832059 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] PATH_INFO: `/v3/users` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:14.832707 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:14.834642 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:14.860735 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1444/2917] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Sep 15 13:08:14 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 13:08:14.862202 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:14.873666 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c0b39-d18d-4f14-bbc7-c61fa0b2ca87 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:14.878823 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:14.879493 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:14.879805 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:14.880068 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:14.880712 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:14.882321 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:14.894231 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1474/2918] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 13:08:14.898768 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:14.909395 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd861c-920d-46ee-90bb-0b01f6ab4e85 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:14.914497 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:14.915349 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:14.915624 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:14.915929 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] PATH_INFO: `/v3/projects/551ec67a580d45028bafcf2fee3d9412/users/53561dfc1d1549ddb6f01fa2e0c6d714/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:14.932102 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551ec67a580d45028bafcf2fee3d9412, user_id=53561dfc1d1549ddb6f01fa2e0c6d714, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:14.934832 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:14.950912 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1445/2919] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:08:14 2022] PUT /identity/v3/projects/551ec67a580d45028bafcf2fee3d9412/users/53561dfc1d1549ddb6f01fa2e0c6d714/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:08:14.955095 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:14.965112 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404ec45-f589-4a18-93cc-7ee318abd170 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:15.024488 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d265b8-eac2-4a3d-ab2e-c9250f93f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:15.025106 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d265b8-eac2-4a3d-ab2e-c9250f93f016 admin admin] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:15.025379 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d265b8-eac2-4a3d-ab2e-c9250f93f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:15.025662 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d265b8-eac2-4a3d-ab2e-c9250f93f016 admin admin] PATH_INFO: `/v3/roles` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:15.026270 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d265b8-eac2-4a3d-ab2e-c9250f93f016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:15.027927 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d265b8-eac2-4a3d-ab2e-c9250f93f016 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:15.037782 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1475/2920] 10.222.0.42 () {58 vars in 1122 bytes} [Thu Sep 15 13:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 13:08:15.042345 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:15.052426 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ad029-9a0e-4875-a01d-b97a4cc38535 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:15.057595 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:15.058234 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:15.058506 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:15.058769 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] PATH_INFO: `/v3/projects/551ec67a580d45028bafcf2fee3d9412/users/53561dfc1d1549ddb6f01fa2e0c6d714/roles/acf6726bf46b432c9dbb6d1f5610893f` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:15.060687 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551ec67a580d45028bafcf2fee3d9412, user_id=53561dfc1d1549ddb6f01fa2e0c6d714, role_id=acf6726bf46b432c9dbb6d1f5610893f)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:15.063804 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:15.075505 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1446/2921] 10.222.0.42 () {60 vars in 1483 bytes} [Thu Sep 15 13:08:15 2022] PUT /identity/v3/projects/551ec67a580d45028bafcf2fee3d9412/users/53561dfc1d1549ddb6f01fa2e0c6d714/roles/acf6726bf46b432c9dbb6d1f5610893f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:08:19.914207 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2aad-bbba-4ad9-b9d1-7d7b62a377b4 None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:19.915218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2aad-bbba-4ad9-b9d1-7d7b62a377b4 None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:19.915218 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac2aad-bbba-4ad9-b9d1-7d7b62a377b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:19.947238 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-27ac2aad-bbba-4ad9-b9d1-7d7b62a377b4 None None] MFA Rules not processed for user `53561dfc1d1549ddb6f01fa2e0c6d714`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:19.949081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-27ac2aad-bbba-4ad9-b9d1-7d7b62a377b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:19.993107 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:20.030120 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1476/2922] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:20.046322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:20.048132 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:20.123600 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526daa62-d760-4877-bc53-7ed85eba17b7 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:20.128290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6083dd9ef4544aa6a596915f5b899b8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:20.129149 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:20.129491 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:20.129823 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:20.180601 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:20.200813 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:20.202290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:20.211692 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1447/2923] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:20.352234 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522da35-8b1a-4e4d-a107-648a691747ad None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:20.352508 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522da35-8b1a-4e4d-a107-648a691747ad None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:20.352778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522da35-8b1a-4e4d-a107-648a691747ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:20.383598 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-6522da35-8b1a-4e4d-a107-648a691747ad None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:20.384831 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6522da35-8b1a-4e4d-a107-648a691747ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:20.453088 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1477/2924] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:20.505884 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:20.507322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:20.578504 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969946c7-11e1-4b55-adfb-02965cd35741 service glance] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:20.584274 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec3da5-9c41-4930-9d0c-356d737cd31e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:20.584883 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3da5-9c41-4930-9d0c-356d737cd31e service swift] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:20.585153 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3da5-9c41-4930-9d0c-356d737cd31e service swift] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:20.585412 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3da5-9c41-4930-9d0c-356d737cd31e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:20.593919 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3da5-9c41-4930-9d0c-356d737cd31e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:20.595478 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3da5-9c41-4930-9d0c-356d737cd31e service swift] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:20.603742 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1448/2925] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 13:08:29.230767 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89cb45-2c02-4722-b76f-5bb7472ee6fa None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:29.231278 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89cb45-2c02-4722-b76f-5bb7472ee6fa None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:29.231392 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89cb45-2c02-4722-b76f-5bb7472ee6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:29.255171 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-3a89cb45-2c02-4722-b76f-5bb7472ee6fa None None] MFA Rules not processed for user `ffd78b89e2a646d1b34d5358c84696c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:29.256834 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-3a89cb45-2c02-4722-b76f-5bb7472ee6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:29.266214 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1478/2926] 10.222.0.42 () {58 vars in 958 bytes} [Thu Sep 15 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:30.600298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=40 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:31.224965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] REQUEST_METHOD: `POST` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:31.225246 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:31.225516 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:31.246190 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.auth.core [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81588) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:08:31.247418 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:31.254773 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1449/2927] 10.222.0.42 () {58 vars in 1009 bytes} [Thu Sep 15 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:08:31.267639 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89cb45-2c02-4722-b76f-5bb7472ee6fa None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:31.282972 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89cb45-2c02-4722-b76f-5bb7472ee6fa None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:31.288387 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:31.288986 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:31.289257 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:31.289526 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:31.298622 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:31.300237 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:31.309236 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1479/2928] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 13:08:38.123955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:38.125513 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:38.160642 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:38.193087 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71178e9-b12d-4e23-89a2-017057bba78b None None] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:38.197238 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:38.197951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:38.198307 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:38.198976 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:38.200938 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:38.248046 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd39ff-9df7-4b84-aa89-ee6366ec4abf service swift] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:38.251960 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:38.252576 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:38.252856 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:38.253123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:38.255158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:38.324809 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:38.326759 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:38.341351 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=100 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:38.360640 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1450/2929] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:38.369233 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:38.371060 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:38.383549 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1480/2930] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 13:08:48.357172 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=66 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:48.377695 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=7 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:08:52.993373 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:53.002576 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7be38b-2e24-4b25-a0d9-8e0f6468e612 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:53.006979 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:53.007580 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:53.007909 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:53.008182 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:53.019004 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:53.020893 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:53.031649 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1451/2931] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:53.176551 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:53.194001 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8233a8a-e08f-4539-ae0a-20759ba98b6d service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:53.198801 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:53.199429 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:53.199729 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:53.200002 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:53.202266 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:53.213755 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:53.215148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:53.224815 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1481/2932] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:08:53.562094 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:08:53.574199 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0787ea-ec4a-4f79-821b-646719ed3525 service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:08:53.579091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:08:53.579721 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:08:53.580017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:08:53.580285 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:08:53.582322 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:08:53.602528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:08:53.604247 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:08:53.616734 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1452/2933] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:08:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:09:03.221176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=6 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:03.611226 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=12 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:09:23.103289 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:09:23.112568 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f7acf-abf1-4d26-b6ac-05275f4eee9e service neutron] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:09:23.116626 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27769417-6467-4590-8f4f-8d39b07932b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a022b80e5eb460b92e4e99728b22770', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:09:23.117242 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27769417-6467-4590-8f4f-8d39b07932b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:09:23.117520 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27769417-6467-4590-8f4f-8d39b07932b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:09:23.117786 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27769417-6467-4590-8f4f-8d39b07932b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:09:23.119604 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-27769417-6467-4590-8f4f-8d39b07932b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:09:23.130477 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27769417-6467-4590-8f4f-8d39b07932b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:09:23.132148 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27769417-6467-4590-8f4f-8d39b07932b0 service neutron] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:09:23.142951 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1482/2934] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:09:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:09:33.139023 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=6 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:14.029436 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:14.031028 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:14.048188 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abcaf7-a13b-4f91-ae03-5b974b89fbfd service neutron] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:14.054680 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2cabfcf8224f70a3129dc308e67b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:14.055113 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:14.055588 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:14.056035 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:14.057965 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:14.073602 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:14.075359 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:14.100431 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1453/2935] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:10:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:10:16.245227 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] REQUEST_METHOD: `POST` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:16.246085 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:16.246680 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:16.304318 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.auth.core [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] MFA Rules not processed for user `b2684f91284d49fc98b4caaace8cbba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81589) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 13:10:16.305608 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:16.322737 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1483/2936] 10.222.0.42 () {58 vars in 967 bytes} [Thu Sep 15 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 13:10:16.366269 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:16.388647 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d7089-97c0-4558-ad3e-0803d8718d5e service nova] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:16.394841 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75b6057e2fd7438cb3fa2a0ec2933fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:16.395409 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:16.395688 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:16.395995 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:16.405069 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:16.406727 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:16.415261 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1454/2937] 10.222.0.42 () {60 vars in 1384 bytes} [Thu Sep 15 13:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 13:10:20.644485 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:20.646142 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:20.718262 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ad2a6-2d0f-4946-a7c4-d2262c4fc67d None None] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:20.723571 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:20.724302 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:20.724529 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:20.724864 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:20.728259 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:20.741155 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:20.742866 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:20.753216 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1484/2938] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:10:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:10:23.282067 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:23.293712 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4b20-33df-4798-93bf-33c4de832013 service swift] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:23.298725 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:23.299540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] REQUEST_METHOD: `GET` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:23.300066 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:23.300446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:23.302249 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:23.318091 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:23.320590 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:23.343387 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1455/2939] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:10:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:10:24.970830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:25.037658 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c05a3-9eee-4441-ba4a-1baabc16894a service placement] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:25.042176 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:25.042830 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:25.043081 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:25.043370 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] PATH_INFO: `/v3/users/ffd78b89e2a646d1b34d5358c84696c6` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:25.044566 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd78b89e2a646d1b34d5358c84696c6)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:25.046532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:25.099503 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd78b89e2a646d1b34d5358c84696c6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.103874 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:25.109268 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd78b89e2a646d1b34d5358c84696c6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.119249 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd78b89e2a646d1b34d5358c84696c6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.119853 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd78b89e2a646d1b34d5358c84696c6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.132026 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd78b89e2a646d1b34d5358c84696c6'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.138961 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1485/2940] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:10:24 2022] DELETE /identity/v3/users/ffd78b89e2a646d1b34d5358c84696c6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:10:25.313446 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:25.326512 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f50d1f-cf2d-422c-905c-225afdc3e4d3 service placement] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:25.401585 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:25.403032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:25.403489 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:25.404499 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] PATH_INFO: `/v3/projects/73320feb45d641888a60994b0955a7e0` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:25.407014 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73320feb45d641888a60994b0955a7e0)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:25.409047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:25.483196 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73320feb45d641888a60994b0955a7e0', 'request_id': 'req-e0ca4b46-a63d-4a19-8612-125fa608b75d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.494077 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73320feb45d641888a60994b0955a7e0', 'request_id': 'req-e0ca4b46-a63d-4a19-8612-125fa608b75d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.501032 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73320feb45d641888a60994b0955a7e0', 'request_id': 'req-e0ca4b46-a63d-4a19-8612-125fa608b75d'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.515564 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] The token cache is being invalidate because project 73320feb45d641888a60994b0955a7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:10:25.515796 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.516868 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.518777 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1456/2941] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:10:25 2022] DELETE /identity/v3/projects/73320feb45d641888a60994b0955a7e0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:10:25.522988 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:25.525089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:25.539545 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e970613-99f2-4f38-a5d4-e94aa8c9d0d7 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:25.619602 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:25.620942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:25.620942 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:25.621704 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] PATH_INFO: `/v3/users/53561dfc1d1549ddb6f01fa2e0c6d714` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:25.623022 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53561dfc1d1549ddb6f01fa2e0c6d714)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:25.625843 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:25.704201 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53561dfc1d1549ddb6f01fa2e0c6d714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.715186 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53561dfc1d1549ddb6f01fa2e0c6d714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.727177 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53561dfc1d1549ddb6f01fa2e0c6d714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.728089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53561dfc1d1549ddb6f01fa2e0c6d714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.745779 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53561dfc1d1549ddb6f01fa2e0c6d714'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:25.757561 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1486/2942] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:10:25 2022] DELETE /identity/v3/users/53561dfc1d1549ddb6f01fa2e0c6d714 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:10:25.947469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:25.949347 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:25.974584 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca4b46-a63d-4a19-8612-125fa608b75d admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:26.028310 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:26.047614 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:26.048289 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:26.048561 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:26.048830 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] PATH_INFO: `/v3/projects/551ec67a580d45028bafcf2fee3d9412` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:26.049951 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=551ec67a580d45028bafcf2fee3d9412)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:26.051955 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:26.111019 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551ec67a580d45028bafcf2fee3d9412', 'request_id': 'req-c8467ca9-bbee-46cb-a846-32d718dd4689'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:26.120494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551ec67a580d45028bafcf2fee3d9412', 'request_id': 'req-c8467ca9-bbee-46cb-a846-32d718dd4689'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:26.126633 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551ec67a580d45028bafcf2fee3d9412', 'request_id': 'req-c8467ca9-bbee-46cb-a846-32d718dd4689'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:26.138616 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] The token cache is being invalidate because project 551ec67a580d45028bafcf2fee3d9412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:10:26.138881 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:26.139540 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:26.141112 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1457/2943] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:10:25 2022] DELETE /identity/v3/projects/551ec67a580d45028bafcf2fee3d9412 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:10:27.364494 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:27.366406 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:27.380982 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29089c7-2534-4c30-b008-fda438f6aa47 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:27.435557 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:27.453000 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:27.453578 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:27.453857 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:27.454123 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] PATH_INFO: `/v3/users/b02063ce6d3d45d6895d1e2a782efe3b` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:27.456592 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02063ce6d3d45d6895d1e2a782efe3b)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:27.458521 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:27.522030 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02063ce6d3d45d6895d1e2a782efe3b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.532743 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02063ce6d3d45d6895d1e2a782efe3b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.545127 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02063ce6d3d45d6895d1e2a782efe3b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.545893 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02063ce6d3d45d6895d1e2a782efe3b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.565049 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02063ce6d3d45d6895d1e2a782efe3b'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.572646 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1487/2944] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:10:27 2022] DELETE /identity/v3/users/b02063ce6d3d45d6895d1e2a782efe3b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:10:27.795731 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:27.798365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:27.814402 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8467ca9-bbee-46cb-a846-32d718dd4689 admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:27.893365 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:27.894017 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:27.894290 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:27.894528 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] PATH_INFO: `/v3/projects/13edf09dc2b249958b4020dcc7e94291` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:27.895690 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13edf09dc2b249958b4020dcc7e94291)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:27.897618 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:27.960479 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13edf09dc2b249958b4020dcc7e94291', 'request_id': 'req-d57eba39-d928-42b1-8227-b985b4d03b5a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.970817 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13edf09dc2b249958b4020dcc7e94291', 'request_id': 'req-d57eba39-d928-42b1-8227-b985b4d03b5a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.978924 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13edf09dc2b249958b4020dcc7e94291', 'request_id': 'req-d57eba39-d928-42b1-8227-b985b4d03b5a'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.993197 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] The token cache is being invalidate because project 13edf09dc2b249958b4020dcc7e94291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:10:27.993469 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.994298 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:27.995917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1458/2945] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:10:27 2022] DELETE /identity/v3/projects/13edf09dc2b249958b4020dcc7e94291 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 13:10:28.001298 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:28.006004 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:28.024532 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619c4b3-5997-4c62-bc5f-1aa95e6fa519 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:28.090570 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:28.091114 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:28.091718 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:28.092031 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] PATH_INFO: `/v3/users/b05aabb1f0fc4c88a8a8bb09eab46b3d` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:28.093239 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05aabb1f0fc4c88a8a8bb09eab46b3d)` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:28.095175 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:28.148199 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05aabb1f0fc4c88a8a8bb09eab46b3d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.156983 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05aabb1f0fc4c88a8a8bb09eab46b3d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.164125 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05aabb1f0fc4c88a8a8bb09eab46b3d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.164778 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05aabb1f0fc4c88a8a8bb09eab46b3d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.170089 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:28.180113 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.notifications [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05aabb1f0fc4c88a8a8bb09eab46b3d'} {{(pid=81589) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.187104 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1488/2946] 10.222.0.42 () {58 vars in 1224 bytes} [Thu Sep 15 13:10:28 2022] DELETE /identity/v3/users/b05aabb1f0fc4c88a8a8bb09eab46b3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:10:28.369207 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Authenticating user token {{(pid=81588) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:10:28.376244 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.fernet_utils [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81588) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:10:28.388351 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:28.391184 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eba39-d928-42b1-8227-b985b4d03b5a admin admin] Validating token access rules against request {{(pid=81588) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:10:28.454573 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e74cf16638b84fdcb3063b017c210c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f45a231e90ab44d5b27215f7d1c94ccd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81588) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:10:28.455218 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:10:28.455494 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:10:28.455786 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] PATH_INFO: `/v3/projects/2961ed1182f149ad83f76e97eb323411` {{(pid=81588) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:10:28.456917 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2961ed1182f149ad83f76e97eb323411)` {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:10:28.458834 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] RBAC: Authorization granted {{(pid=81588) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:10:28.507495 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2961ed1182f149ad83f76e97eb323411', 'request_id': 'req-479cd5f9-af65-4087-b339-4102d0252621'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.517784 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2961ed1182f149ad83f76e97eb323411', 'request_id': 'req-479cd5f9-af65-4087-b339-4102d0252621'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.525604 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2961ed1182f149ad83f76e97eb323411', 'request_id': 'req-479cd5f9-af65-4087-b339-4102d0252621'} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.537047 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] The token cache is being invalidate because project 2961ed1182f149ad83f76e97eb323411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81588) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 13:10:28.537334 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.538021 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG keystone.notifications [None req-479cd5f9-af65-4087-b339-4102d0252621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81588) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 13:10:28.539730 dv-cinder-836083-13-smb devstack@keystone.service[81588]: [pid: 81588|app: 0|req: 1459/2947] 10.222.0.42 () {58 vars in 1233 bytes} [Thu Sep 15 13:10:28 2022] DELETE /identity/v3/projects/2961ed1182f149ad83f76e97eb323411 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 13:10:38.183414 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:10:38.533966 dv-cinder-836083-13-smb devstack@keystone.service[81588]: DEBUG dbcounter [-] [81588] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 13:11:53.791897 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Authenticating user token {{(pid=81589) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 13:11:53.793543 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:11:53.870585 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca50861-a3c0-49f7-b38b-7b040936b290 admin admin] Validating token access rules against request {{(pid=81589) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 13:11:53.942653 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2854dfd-cd0b-40d3-9a70-d29068f3c1a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d89f4bf4bcb4b408a693a68edf87878', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297a1da4cf24be59d9195e935f4136f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81589) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 13:11:53.943284 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854dfd-cd0b-40d3-9a70-d29068f3c1a2 service placement] REQUEST_METHOD: `GET` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 13:11:53.943555 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854dfd-cd0b-40d3-9a70-d29068f3c1a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 13:11:53.943848 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854dfd-cd0b-40d3-9a70-d29068f3c1a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81589) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 13:11:53.945736 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.fernet_utils [None req-a2854dfd-cd0b-40d3-9a70-d29068f3c1a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81589) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 13:11:53.958296 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2854dfd-cd0b-40d3-9a70-d29068f3c1a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 13:11:53.960158 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2854dfd-cd0b-40d3-9a70-d29068f3c1a2 service placement] RBAC: Authorization granted {{(pid=81589) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 13:11:53.970562 dv-cinder-836083-13-smb devstack@keystone.service[81589]: [pid: 81589|app: 0|req: 1489/2948] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Sep 15 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 13:12:03.966288 dv-cinder-836083-13-smb devstack@keystone.service[81589]: DEBUG dbcounter [-] [81589] Writing DB stats keystone:SELECT=58 {{(pid=81589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}